-- Logs begin at Thu 2022-08-11 09:07:17 UTC, end at Thu 2022-08-11 10:19:33 UTC. -- Aug 11 09:51:09.406715 dv-cinder-815660-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 09:51:09.416435 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 09:51:09 2022] *** Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: nodename: dv-cinder-815660-9-iscsi Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: machine: x86_64 Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: clock source: unix Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: pcre jit disabled Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: detected number of CPU cores: 4 Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: current working directory: / Aug 11 09:51:09.418369 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: detected binary path: /usr/bin/uwsgi-core Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: your processes number limit is 47680 Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: your memory page size is 4096 bytes Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: detected max file descriptor number: 2048 Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: lock engine: pthread robust mutexes Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: thunder lock: enabled Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 09:51:09.419026 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 09:51:09.458386 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: Python main interpreter initialized at 0x563e0bea09c0 Aug 11 09:51:09.458386 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: python threads support enabled Aug 11 09:51:09.458386 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: your server socket listen backlog is limited to 100 connections Aug 11 09:51:09.458386 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: your mercy for graceful operations on workers is 90 seconds Aug 11 09:51:09.458701 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 09:51:09.458780 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: *** Operational MODE: preforking *** Aug 11 09:51:09.458979 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: *** uWSGI is running in multiple interpreter mode *** Aug 11 09:51:09.458979 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: spawned uWSGI master process (pid: 105892) Aug 11 09:51:09.459180 dv-cinder-815660-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 09:51:09.461861 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: spawned uWSGI worker 1 (pid: 105893, cores: 1) Aug 11 09:51:09.461861 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: spawned uWSGI worker 2 (pid: 105894, cores: 1) Aug 11 09:51:09.461861 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 09:51:10.120134 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 09:51:10.121993 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 09:51:11.207345 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:51:11.207345 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: from cryptography.utils import int_from_bytes Aug 11 09:51:11.207986 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:51:11.207986 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: from cryptography.utils import int_from_bytes Aug 11 09:51:11.208129 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:51:11.208129 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: from cryptography.utils import int_from_bytes Aug 11 09:51:11.208129 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:51:11.208129 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: from cryptography.utils import int_from_bytes Aug 11 09:51:13.691816 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:51:13.692386 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:51:13.692735 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:51:13.692830 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:51:13.692938 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:51:13.693047 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:51:13.693140 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:51:13.693229 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:51:13.693319 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:51:13.693404 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:51:13.693545 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.693778 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.693887 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.694656 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.694804 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695125 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695227 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695451 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695547 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695758 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.695858 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696074 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696159 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696387 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696478 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696709 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696804 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.696965 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697109 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697315 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697422 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697632 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-9-iscsi {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697719 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.697949 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698035 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-9-iscsi {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698250 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698343 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698551 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698643 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698859 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.698958 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699158 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699243 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699464 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699549 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699761 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.699846 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.700076 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.700251 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.701529 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.701636 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.701775 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.701897 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702032 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702176 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702309 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702441 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702566 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702696 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702835 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.702965 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703077 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703199 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703322 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703452 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703589 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703713 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703844 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.703968 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704247 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-9-iscsi {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704371 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-9-iscsi {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704495 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704703 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704829 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.704959 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705096 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705220 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705343 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705486 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705619 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705743 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.705866 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706001 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706115 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706244 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706369 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706760 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.706895 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707057 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707187 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707410 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707681 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707818 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.707991 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708120 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708288 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708415 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708592 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708730 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.708892 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709049 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709223 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709359 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709522 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709658 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.709922 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710048 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710194 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710331 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710505 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710633 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710825 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.710953 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711141 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711278 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711462 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711589 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711716 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711840 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.711966 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712100 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712232 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712365 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712851 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.712980 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713188 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713316 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713493 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713625 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713796 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.713931 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714098 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714235 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714400 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714528 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714701 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.714837 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715004 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715137 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715310 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715445 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715616 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715743 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.715928 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716055 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716226 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716365 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716540 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716667 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716861 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.716995 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717190 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717334 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717482 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717675 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717803 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.717928 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718114 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718258 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718415 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718544 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718726 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.718854 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719040 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719182 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719341 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719468 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719639 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719777 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.719941 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720082 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720247 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720377 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720569 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720697 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.720866 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721000 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721157 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721283 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721418 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721543 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721708 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.721843 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722021 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722149 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722324 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722453 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722629 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722757 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.722928 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723054 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723223 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723350 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723524 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723652 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723825 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.723952 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724126 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724266 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724426 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724563 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724725 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.724853 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725063 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725214 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725414 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725551 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725687 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.725878 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726023 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726156 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726282 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726413 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726671 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.726974 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727134 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727262 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727434 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727571 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727738 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.727885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728046 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728155 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728344 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728438 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728646 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728837 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.728954 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729127 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729277 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729415 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729575 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729715 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.729906 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730042 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730177 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730301 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730463 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730604 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730775 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.730904 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731072 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731199 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731373 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731501 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731678 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731811 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.731978 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732277 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732406 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732577 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732703 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732872 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.732997 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733199 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733326 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733479 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733607 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733773 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.733903 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734071 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734197 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734363 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734498 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734659 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734794 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.734973 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735099 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735276 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735404 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735576 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735714 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.735877 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.736005 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.736178 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.736303 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.736497 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:51:13.736635 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.736820 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.736946 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.737174 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.737302 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.737490 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.737629 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.737896 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738035 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738161 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738294 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738449 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738578 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738758 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.738893 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739068 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739197 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739382 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739508 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739686 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739819 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.739992 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.740127 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.740298 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.740437 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.740606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.740740 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.741467 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.741640 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.741830 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.741972 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742098 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742304 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742433 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742627 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742767 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.742950 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743078 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743275 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743411 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743589 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743729 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.743905 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744032 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744213 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744349 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744544 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744663 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744857 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.744986 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745199 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745338 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745521 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745651 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745839 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.745968 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746146 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746281 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746451 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746581 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746754 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.746890 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747072 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747199 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747382 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747513 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747691 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.747817 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748010 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748132 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748318 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748422 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748625 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748719 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.748929 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749053 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749261 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749566 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749652 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749876 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.749970 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750186 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750270 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750508 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750591 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750804 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.750906 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751117 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751210 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751428 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751512 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751733 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.751819 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752042 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752125 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752345 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752429 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752647 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752731 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.752950 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753063 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753282 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753369 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753645 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753736 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.753960 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754050 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754265 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754356 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754584 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754690 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.754915 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755011 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755214 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755296 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755526 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755610 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755834 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.755924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.756140 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.756232 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.756442 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.756598 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.757367 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.757525 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.757745 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.757843 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.757985 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758135 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758298 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758458 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758766 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.758930 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759069 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759240 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759389 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759547 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759691 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759871 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.759993 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760179 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760303 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760485 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760609 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760799 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.760915 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761130 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761234 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761441 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761754 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.761867 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762065 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762177 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762389 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762474 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762702 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.762785 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763016 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763109 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763348 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763433 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763682 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763778 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.763988 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764085 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764313 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764398 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764612 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764702 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.764921 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765123 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765271 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765423 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765580 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765720 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.765864 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766042 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766188 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766325 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766534 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766673 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766810 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.766962 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767101 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767238 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767375 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767525 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767673 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767810 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.767948 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768098 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768323 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768468 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768616 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768768 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.768908 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769076 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769221 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769369 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769521 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769669 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769808 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.769945 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770081 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770226 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770373 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770518 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770657 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770822 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.770961 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771107 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771256 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771400 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771546 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771686 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.771984 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772146 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772289 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772427 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772563 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772701 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.772846 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773038 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773203 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773342 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773491 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773637 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773786 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.773949 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774107 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774269 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774415 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774577 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774717 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.774877 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775029 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775179 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775316 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775470 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775610 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775795 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.775942 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776107 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776251 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776424 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776745 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.776883 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777043 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777200 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777350 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777501 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777640 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777778 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.777939 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778093 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778232 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778456 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778601 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778739 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.778876 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779035 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779175 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779320 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779468 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779775 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.779929 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780094 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780403 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780556 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780724 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.780948 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781202 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781362 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781503 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781654 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781836 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.781991 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782139 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782285 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782431 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782569 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782715 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782860 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.782999 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783147 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783286 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783422 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783567 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783715 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.783861 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784008 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784146 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784292 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784444 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784590 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784739 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.784877 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785042 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785187 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785337 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785477 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785615 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785751 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.785888 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786034 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786189 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786399 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786595 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786746 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.786886 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787042 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787181 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787318 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787463 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787602 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787781 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.787938 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788077 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788221 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788359 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788583 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788735 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.788894 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789076 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789236 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789236 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789508 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789508 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789784 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.789921 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790057 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790057 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790314 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790461 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790599 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790748 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.790885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791030 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791167 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791313 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791451 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791596 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791732 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.791870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792013 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792159 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792305 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792443 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792591 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792746 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.792897 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793053 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793197 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793334 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793471 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793618 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793765 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.793929 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794075 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794234 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794386 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794535 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794692 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794831 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.794968 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795105 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795249 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795412 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795566 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795729 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.795883 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796021 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796158 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796319 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796458 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796638 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796784 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.796928 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797123 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797279 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797455 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797600 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797737 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.797889 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798055 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798210 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798370 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798678 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798832 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.798972 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799110 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799286 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799433 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799599 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799743 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.799923 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800078 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800241 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800384 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800569 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800757 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.800911 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801083 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801229 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801374 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801522 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801669 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801808 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.801945 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802090 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802229 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802386 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802532 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802671 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802808 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.802952 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.803091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.803237 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.803900 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804045 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804197 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804380 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804604 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804746 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.804895 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805065 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805213 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805360 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805512 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805658 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805797 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.805935 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806079 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806218 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806364 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806503 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806647 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806851 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.806998 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807137 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807284 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807423 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807560 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807697 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807834 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.807984 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808124 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808261 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808399 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808536 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808704 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.808929 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809113 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809263 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809402 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809685 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809836 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.809982 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810121 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810258 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810395 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810553 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810692 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810830 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.810966 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811103 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811385 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811524 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811661 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811798 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.811935 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812072 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812217 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812504 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812641 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812778 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.812915 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813115 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813262 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813407 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813684 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813835 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.813974 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814120 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814276 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814414 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814552 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814698 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814837 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.814981 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815127 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815265 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815414 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815560 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815700 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815837 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.815982 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816132 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816270 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816417 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816555 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816694 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.816872 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817035 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817200 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817340 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817477 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817613 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817751 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.817888 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818053 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818193 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818338 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818477 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818614 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818751 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.818920 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.819671 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.819671 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820010 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820010 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820340 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820508 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820661 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820806 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.820957 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821157 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821316 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821462 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821758 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.821903 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822059 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822213 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822359 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822513 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822657 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822801 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.822945 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823099 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823251 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823396 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823539 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823691 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823835 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.823991 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824137 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824289 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824448 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824592 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824745 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.824890 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825057 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825210 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825375 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825521 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825674 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825818 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.825962 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826104 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826248 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826402 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826559 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826704 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.826894 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827046 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827198 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827343 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827500 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827644 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827788 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.827949 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828164 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828351 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828508 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828660 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828805 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.828949 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829124 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829281 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829429 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829579 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829811 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.829999 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830157 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830312 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830473 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830617 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830762 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.830906 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.831049 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.831202 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.831348 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.831747 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.831892 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832035 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832178 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832331 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832477 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832631 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832782 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.832927 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833335 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833481 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833625 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833769 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.833920 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834074 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834219 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834371 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834523 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834727 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.834924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835135 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835285 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835440 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835586 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835738 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.835883 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836037 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836189 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836333 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836477 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836621 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836795 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.836985 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837162 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837320 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837466 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837610 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837764 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.837919 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838064 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838208 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838352 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838495 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838664 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838812 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.838964 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839109 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839253 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839396 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839549 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839694 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.839926 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840086 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840232 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840385 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840537 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840693 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840838 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.840982 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841175 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841334 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841480 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841624 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841775 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.841919 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842063 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842216 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842216 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842495 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842651 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842795 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.842947 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843104 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843249 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843392 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843392 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843681 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.843906 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844090 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844250 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844395 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844546 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844702 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844702 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.844992 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845167 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845318 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845467 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845621 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845775 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.845920 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846064 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846216 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846362 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846516 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846674 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846819 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.846963 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847151 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847309 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847471 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847616 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847759 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.847759 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848033 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848178 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848332 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848492 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848637 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848780 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848933 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.848933 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.849295 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.849442 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.849592 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.849744 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.849931 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.850151 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.850821 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.850978 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851142 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851288 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851590 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851742 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.851887 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852125 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852282 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852429 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852590 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852737 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.852890 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853080 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853234 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853378 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853522 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853834 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.853981 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854125 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854268 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854412 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854557 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854714 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.854866 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855180 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855326 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855470 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855628 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855781 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.855781 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856060 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856060 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856340 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856486 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856631 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856774 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.856928 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857126 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857333 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857480 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857635 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857780 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.857923 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858067 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858225 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858379 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858532 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858678 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858822 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.858977 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859133 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859280 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859424 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859577 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859722 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.859894 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860041 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860272 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860425 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860570 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860715 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.860880 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861055 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861209 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861365 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861519 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861678 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861843 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.861989 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862135 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862280 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862424 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862576 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862730 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.862887 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863032 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863177 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863474 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863631 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863790 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.863957 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864110 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864255 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864408 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864554 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864705 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.864860 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865005 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865205 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865361 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865515 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865660 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.865814 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.866519 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.866669 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.866828 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.866974 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867119 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867315 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867465 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867636 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867784 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.867929 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868082 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868227 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868370 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868527 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868527 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868800 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868943 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.868943 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.869259 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.869419 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.869571 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.869715 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.869859 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870003 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870146 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870316 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870534 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870684 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870829 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.870973 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871126 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871284 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871429 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871581 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871734 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.871881 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872040 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872194 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872340 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872491 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872643 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.872787 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873047 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873214 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873374 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873527 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873679 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873830 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.873984 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874129 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874273 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874417 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874569 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874727 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.874872 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875017 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875170 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875314 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875458 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875610 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875759 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.875910 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876053 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876198 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876341 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876495 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876639 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876782 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.876926 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877105 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877263 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877460 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877610 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877610 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.877901 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878047 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878200 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878353 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878498 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878643 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878786 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.878937 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879101 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879247 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879391 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879391 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879663 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879815 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.879970 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880115 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880260 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880403 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880564 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880801 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.880964 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.881173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.881402 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.881634 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.881788 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.881975 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882132 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882278 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882429 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882576 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882720 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.882875 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883032 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883177 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883321 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883465 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883622 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883768 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.883768 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884055 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884201 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884345 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884634 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884786 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.884944 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885141 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885335 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885418 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885497 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885574 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885574 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885715 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885802 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885880 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.885956 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886033 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886126 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886205 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886291 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886368 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886453 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886521 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886664 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886741 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886818 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886893 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.886969 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887053 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887139 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887276 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887488 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887644 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887789 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.887934 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888089 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888235 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888387 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888533 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888684 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.888850 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889004 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889218 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889364 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889508 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889652 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889808 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.889954 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.890106 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.890259 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.890529 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.890680 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.890939 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891101 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891249 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891393 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891545 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891691 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891848 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.891994 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892139 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892283 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892427 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892581 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892726 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.892898 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893072 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893225 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893371 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893528 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893681 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893825 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.893970 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.894115 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.894259 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.894413 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.894566 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.894806 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895107 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895270 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895426 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895580 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895726 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.895878 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896024 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896230 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896398 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896570 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896723 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.896889 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.897118 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.897359 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.897726 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.897992 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898177 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898334 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898487 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898638 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898799 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.898946 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899093 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899272 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899427 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899602 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899750 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.899896 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900048 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900194 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900346 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900567 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900717 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.900863 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901136 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901292 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901437 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901595 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901756 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.901901 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902054 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902200 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902344 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902498 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902643 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902788 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.902933 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903077 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903230 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903384 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903529 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903685 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903831 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.903975 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904129 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904281 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904434 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904580 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904725 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.904877 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905071 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905226 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905373 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905517 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905672 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905827 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.905984 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906129 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906274 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906418 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906563 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906707 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.906860 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907007 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907158 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907307 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907475 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907680 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907833 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.907979 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908124 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908269 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908413 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908566 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908719 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.908864 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909040 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909040 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909335 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909508 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909655 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909800 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.909944 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910088 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910395 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910540 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910685 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910834 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.910980 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911152 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911373 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911543 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911690 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911835 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.911980 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.912134 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.912288 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.912441 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.912585 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.913287 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.913490 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.913746 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914011 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914232 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914533 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914690 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914690 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.914978 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915123 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915276 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915423 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915574 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915729 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.915875 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916020 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916166 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916323 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916469 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916623 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916769 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.916921 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917094 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917247 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917407 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917561 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917754 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.917915 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918062 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918218 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918372 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918528 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918676 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918820 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.918966 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919118 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919274 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919419 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919572 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919718 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.919871 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920029 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920186 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920332 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920477 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920622 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920766 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.920921 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921123 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921277 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921483 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921643 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921798 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.921953 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922120 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922267 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922422 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922567 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922721 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.922867 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923011 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923162 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923315 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923460 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923613 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923761 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.923919 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924065 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924209 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924354 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924526 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924754 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.924913 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925082 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925234 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925389 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925553 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925700 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.925852 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926009 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926155 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926308 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926462 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926608 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.926752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927051 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927215 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927362 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927514 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927665 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.927865 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.928118 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.928300 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.929125 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.929400 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.929606 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.929756 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.929911 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930098 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930258 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930405 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930557 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930712 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930943 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.930943 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931241 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931387 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931531 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931830 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.931976 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932123 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932268 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932412 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932556 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932714 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.932871 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933041 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933195 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933341 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933497 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933644 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933789 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.933933 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934078 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934224 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934377 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934377 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934666 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.934911 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935066 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935214 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935369 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935516 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935661 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935813 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.935959 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936267 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936420 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936566 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936730 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.936876 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937075 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937236 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937383 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937528 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937673 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937817 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.937998 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938145 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938290 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938443 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938597 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938762 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.938916 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939062 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939206 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939350 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939496 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939648 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939803 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.939948 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940099 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940245 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940389 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940553 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940712 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.940865 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941033 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941187 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941342 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941499 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941651 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941797 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.941985 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942140 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942284 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942443 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942601 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942759 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.942914 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943060 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943217 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943364 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943508 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943797 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.943948 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.944124 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.944384 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.944655 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.944822 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945282 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945443 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945591 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945736 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.945881 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946027 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946184 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946330 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946476 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946632 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946778 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.946923 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947086 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947238 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947384 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947527 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947671 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947816 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.947970 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948116 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948261 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948414 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948570 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948728 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.948875 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949043 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949196 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949354 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949501 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949654 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949800 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.949945 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950097 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950242 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950395 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950567 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950714 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:51:13.950867 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950867 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950867 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:51:13.950867 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:51:14.102547 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Registered counter for database nova_api Aug 11 09:51:14.103755 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO dbcounter [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Registered counter for database nova_api Aug 11 09:51:14.123170 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.124613 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_db.sqlalchemy.engines [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.129903 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.131103 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writer thread running {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.186381 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.context [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae211188-ecfc-4a58-9f59-b381cd08d799(cell1) {{(pid=105893) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 09:51:14.187490 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.context [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae211188-ecfc-4a58-9f59-b381cd08d799(cell1) {{(pid=105894) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 09:51:14.190283 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:51:14.190759 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:51:14.191402 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:51:14.191876 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:51:14.192366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:51:14.193071 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:51:14.193488 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:51:14.193600 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:51:14.194751 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:51:14.195211 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:51:14.196157 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_concurrency.lockutils [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:51:14.197221 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:51:14.198188 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO dbcounter [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Registered counter for database nova_cell0 Aug 11 09:51:14.199217 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Registered counter for database nova_cell0 Aug 11 09:51:14.203802 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO dbcounter [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Registered counter for database nova_cell1 Aug 11 09:51:14.204631 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Registered counter for database nova_cell1 Aug 11 09:51:14.212019 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_db.sqlalchemy.engines [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.213732 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.214931 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.216866 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writer thread running {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.217546 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_db.sqlalchemy.engines [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.220922 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.226555 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.359265 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writer thread running {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.366719 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Registered counter for database nova_cell0 Aug 11 09:51:14.368349 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO dbcounter [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Registered counter for database nova_cell0 Aug 11 09:51:14.374158 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.375636 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG oslo_db.sqlalchemy.engines [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:51:14.378672 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.380085 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writer thread running {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:51:14.824594 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:51:14.832073 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:51:14.857252 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: WARNING keystonemiddleware.auth_token [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:51:14.864433 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: WARNING keystonemiddleware.auth_token [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:51:15.177037 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:51:15.183720 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:51:15.188999 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e0bea09c0 pid: 105894 (default app) Aug 11 09:51:15.191090 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:51:15.192264 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Aug 11 09:51:15.192679 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Thu Aug 11 09:51:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:51:15.208085 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: WARNING keystonemiddleware.auth_token [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:51:15.214998 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: WARNING keystonemiddleware.auth_token [None req-0d4b7882-0dc1-41dd-ad4f-37aa43a38329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:51:15.220246 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e0bea09c0 pid: 105893 (default app) Aug 11 09:52:34.745716 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:34.746710 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 11 09:52:34.747114 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:34.759708 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_api:SELECT=3 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:34.760561 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_cell0:SELECT=3 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:34.761648 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_cell1:SELECT=3 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:34.762911 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:35.621467 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-49a1e690-0ecf-4795-bd69-0f2b76520e4f admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:35.652398 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-49a1e690-0ecf-4795-bd69-0f2b76520e4f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898363 Aug 11 09:52:35.665315 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Thu Aug 11 09:52:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 09:52:37.867919 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:37.868912 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-a9379ae6-c496-4258-a0c9-7dad53f1b050 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 11 09:52:37.869359 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:38.363537 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-9fa4efe3-426a-4a69-ba63-a72b40352f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:38.383320 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:52:38.383320 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: warnings.warn(msg) Aug 11 09:52:38.478662 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-9fa4efe3-426a-4a69-ba63-a72b40352f3b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.603186 Aug 11 09:52:38.479630 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:38.492851 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:38.493887 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell0:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:38.495013 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell1:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:38.495836 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:38.703631 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-45be3125-7ae3-42b6-95c0-223c74ade0af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:38.708207 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:52:38.708207 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:52:38.838931 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-45be3125-7ae3-42b6-95c0-223c74ade0af admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351262 Aug 11 09:52:38.839651 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Thu Aug 11 09:52:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:52:41.085325 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-9fa4efe3-426a-4a69-ba63-a72b40352f3b admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:41.086359 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-9fa4efe3-426a-4a69-ba63-a72b40352f3b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 11 09:52:41.086759 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:41.738939 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-50c6f66f-d046-4ccb-a137-f0f882dc4044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:41.758914 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:52:41.758914 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:52:41.846368 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-50c6f66f-d046-4ccb-a137-f0f882dc4044 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.753332 Aug 11 09:52:41.847047 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:41.860552 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-f6d6b2be-8272-4d39-bc96-73272a5525fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:41.863701 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:52:41.863701 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: warnings.warn(msg) Aug 11 09:52:41.989398 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-f6d6b2be-8272-4d39-bc96-73272a5525fd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132640 Aug 11 09:52:41.990206 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Thu Aug 11 09:52:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:52:44.228533 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-50c6f66f-d046-4ccb-a137-f0f882dc4044 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:44.229704 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-50c6f66f-d046-4ccb-a137-f0f882dc4044 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 11 09:52:44.230583 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:44.645927 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-39413743-cb84-42b3-b01c-0bc4b00d8c0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "ram": 1024, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:44.784594 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-39413743-cb84-42b3-b01c-0bc4b00d8c0c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548508 Aug 11 09:52:44.785172 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:44.797542 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-62e1a67f-8a8d-47f7-94e6-2b791fef15e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:44.914734 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-62e1a67f-8a8d-47f7-94e6-2b791fef15e4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120782 Aug 11 09:52:44.915235 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Thu Aug 11 09:52:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:52:47.128963 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-39413743-cb84-42b3-b01c-0bc4b00d8c0c admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:47.130485 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-39413743-cb84-42b3-b01c-0bc4b00d8c0c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Aug 11 09:52:47.130887 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:47.564504 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-158dc8a0-3a6f-45e7-ac42-7991be18aebd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "d3"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:47.655805 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-158dc8a0-3a6f-45e7-ac42-7991be18aebd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517921 Aug 11 09:52:47.657060 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:47.671315 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-72c45428-6793-4613-a765-603dd38e6d48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:47.764244 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-72c45428-6793-4613-a765-603dd38e6d48 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096628 Aug 11 09:52:47.764935 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Thu Aug 11 09:52:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 09:52:49.966279 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-158dc8a0-3a6f-45e7-ac42-7991be18aebd admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:49.968139 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-158dc8a0-3a6f-45e7-ac42-7991be18aebd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 Aug 11 09:52:49.968728 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:50.417363 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:50.508923 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533939 Aug 11 09:52:50.510040 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:50.522668 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-94bcda9d-d860-46fb-a356-3a70c733f47b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:50.621998 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-94bcda9d-d860-46fb-a356-3a70c733f47b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103312 Aug 11 09:52:50.622970 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Thu Aug 11 09:52:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:52:52.838709 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:52.839760 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 11 09:52:52.840202 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:53.291919 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-e1240f21-8d41-4139-b77c-661c1afd0b36 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:53.316935 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-e1240f21-8d41-4139-b77c-661c1afd0b36 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470082 Aug 11 09:52:53.317501 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Thu Aug 11 09:52:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 09:52:56.512844 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:56.513883 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-993fd55c-c6e6-4c5c-b6c4-ef8810f95365 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 11 09:52:56.514456 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:56.973774 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-6a734664-e05e-487a-a946-19847e84d115 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:57.055602 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-6a734664-e05e-487a-a946-19847e84d115 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.531512 Aug 11 09:52:57.056374 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:52:57.070069 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-76059e3b-d334-41e0-99af-42b112d7cfbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:57.143251 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-76059e3b-d334-41e0-99af-42b112d7cfbe admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077193 Aug 11 09:52:57.143749 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Thu Aug 11 09:52:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 09:52:59.337629 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-6a734664-e05e-487a-a946-19847e84d115 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:52:59.338628 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-6a734664-e05e-487a-a946-19847e84d115 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 11 09:52:59.339020 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:52:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:52:59.721938 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-60050308-9c73-4e94-97d6-9de8d873bd00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:52:59.982689 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-60050308-9c73-4e94-97d6-9de8d873bd00 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.637601 Aug 11 09:52:59.983201 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:52:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 09:52:59.995869 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-f0b6c168-67a6-418a-87ce-448ba55822b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:00.130066 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-f0b6c168-67a6-418a-87ce-448ba55822b2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137775 Aug 11 09:53:00.130695 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Thu Aug 11 09:52:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:53:02.362331 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-60050308-9c73-4e94-97d6-9de8d873bd00 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:02.364072 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-60050308-9c73-4e94-97d6-9de8d873bd00 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Aug 11 09:53:02.364558 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:02.806193 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1ecb30cb-b27a-4ca8-8a6d-59ddf6050357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:02.876275 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1ecb30cb-b27a-4ca8-8a6d-59ddf6050357 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.504888 Aug 11 09:53:02.876947 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:53:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 09:53:02.889404 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-f03007dc-0427-4cd5-a8a2-3fd6bf2645cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:02.978424 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-f03007dc-0427-4cd5-a8a2-3fd6bf2645cb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092582 Aug 11 09:53:02.991773 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Thu Aug 11 09:53:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 09:53:05.244864 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1ecb30cb-b27a-4ca8-8a6d-59ddf6050357 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:05.245585 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1ecb30cb-b27a-4ca8-8a6d-59ddf6050357 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 11 09:53:05.246160 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:05.705810 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-83921bf0-1e7b-4adf-b71b-aab49a9ccc2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "ram": 8192, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:05.712155 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:05.888384 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-83921bf0-1e7b-4adf-b71b-aab49a9ccc2a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.636519 Aug 11 09:53:05.889754 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:53:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:53:05.902069 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-bbbf9172-84af-4a3b-ac74-d062bcce6683 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:05.998090 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-bbbf9172-84af-4a3b-ac74-d062bcce6683 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099781 Aug 11 09:53:05.999110 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Thu Aug 11 09:53:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:53:08.214022 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-83921bf0-1e7b-4adf-b71b-aab49a9ccc2a admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:08.214946 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-83921bf0-1e7b-4adf-b71b-aab49a9ccc2a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 11 09:53:08.215343 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:08.642369 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "vcpus": 8}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:08.735613 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.514445 Aug 11 09:53:08.736489 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Thu Aug 11 09:53:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 09:53:08.748906 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-1b49eccd-8d46-415e-aab4-13b8338a3914 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:08.834859 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-1b49eccd-8d46-415e-aab4-13b8338a3914 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089370 Aug 11 09:53:08.850138 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Thu Aug 11 09:53:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:53:28.640750 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:28.641818 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 11 09:53:28.642215 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:29.029350 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-92ecd6d2-55de-4848-8c4a-68b3c0f82272 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:29.048155 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-92ecd6d2-55de-4848-8c4a-68b3c0f82272 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399311 Aug 11 09:53:29.048697 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Thu Aug 11 09:53:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:53:30.107540 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:30.108552 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1f6ff49f-03ce-4af1-9440-4ed9848c0721 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 11 09:53:30.108953 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:30.632266 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-9f125dfd-d76f-45d2-aa17-4720a9138c70 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:30.637851 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.wsgi [None req-9f125dfd-d76f-45d2-aa17-4720a9138c70 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-9f125dfd-d76f-45d2-aa17-4720a9138c70 admin admin] Request method failure captured: Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept: application/json Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept-Encoding: gzip, deflate Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Connection: keep-alive Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Content-Length: 0 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Host: 10.222.0.17 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-System-Scope: None Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: User-Agent: python-novaclient Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Auth-Token: gAAAAABi9NGaGrMCYI2sPcA-LCdNFyvy-gZJCVjWIBCMkJxcc2_5eP5FTP9TG7Dq0isJSqggQzlg2p9Ng4ziGNOhipoZo0K8MRyT9WuO136Mq9kSV4aFXQwkUqEE402OWTXQLt87NKEE2W29vgeAdx8ILREWZTOV2VyQL_7OP9X0bSzm_0dT178 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Id: None Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Name: None Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Identity-Status: Confirmed Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Is-Admin-Project: True Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Id: default Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Name: Default Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Name: admin Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Role: admin,reader,member Aug 11 09:53:30.641091 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Roles: admin,reader,member Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant: admin Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Name: admin Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User: admin Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Id: default Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Name: Default Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Name: admin Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: method: > Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: exception: Flavor 42 could not be found. Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: action_args: {'id': '42'} Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:30.642676 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:30.643641 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.644727 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-9f125dfd-d76f-45d2-aa17-4720a9138c70 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:30.646392 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-9f125dfd-d76f-45d2-aa17-4720a9138c70 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389649 Aug 11 09:53:30.646392 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Aug 11 09:53:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:30.653830 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-8e8eb010-e4a8-4486-9da0-9ccb91cad45d admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:30.657971 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:30.676728 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-8e8eb010-e4a8-4486-9da0-9ccb91cad45d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026417 Aug 11 09:53:30.677405 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:53:30.687011 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-fc890662-c585-490f-b7cb-15c4d53d50c4 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:30.711889 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-fc890662-c585-490f-b7cb-15c4d53d50c4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028372 Aug 11 09:53:30.712353 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 09:53:30.721534 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-f9b9aca3-57da-4df9-801c-a4d165c98f5f admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:30.727923 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-f9b9aca3-57da-4df9-801c-a4d165c98f5f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-f9b9aca3-57da-4df9-801c-a4d165c98f5f admin admin] Request method failure captured: Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept: application/json Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Connection: keep-alive Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Content-Length: 0 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Host: 10.222.0.17 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABi9NGaGrMCYI2sPcA-LCdNFyvy-gZJCVjWIBCMkJxcc2_5eP5FTP9TG7Dq0isJSqggQzlg2p9Ng4ziGNOhipoZo0K8MRyT9WuO136Mq9kSV4aFXQwkUqEE402OWTXQLt87NKEE2W29vgeAdx8ILREWZTOV2VyQL_7OP9X0bSzm_0dT178 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Role: admin,reader,member Aug 11 09:53:30.731027 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Roles: admin,reader,member Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant: admin Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User: admin Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Name: admin Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: method: > Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: exception: Flavor 42 could not be found. Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: action_args: {'id': '42'} Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:30.732592 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:30.733397 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:30.734450 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-f9b9aca3-57da-4df9-801c-a4d165c98f5f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:30.735978 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-f9b9aca3-57da-4df9-801c-a4d165c98f5f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014393 Aug 11 09:53:30.735978 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Aug 11 09:53:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:31.713650 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-fc890662-c585-490f-b7cb-15c4d53d50c4 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:31.714680 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-fc890662-c585-490f-b7cb-15c4d53d50c4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 11 09:53:31.715070 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:32.242517 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1a066d04-0b52-4f88-8080-136c1ef37a17 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:32.247798 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-1a066d04-0b52-4f88-8080-136c1ef37a17 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1a066d04-0b52-4f88-8080-136c1ef37a17 admin admin] Request method failure captured: Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept: application/json Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Connection: keep-alive Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Content-Length: 0 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Host: 10.222.0.17 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABi9NGb0Lfx5O_fSUcw3sDeFOW4QuvldNL8zQjNUAUZNT7cK45aZUGzN4Vn9I4CGTpGQ-ADd8NBmdkNpRpXGUqRO_0gExmSkrbVrr6Pkp4vSxGxJsqQc4tbM0JZ1-4UO6u9W-myuK9a8cuM2oe5hPm6Ip8dvBBxwd1IIwI2h0wclhQ7J14 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Role: admin,reader,member Aug 11 09:53:32.249321 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Roles: admin,reader,member Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant: admin Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User: admin Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Name: admin Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: method: > Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: exception: Flavor 84 could not be found. Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: action_args: {'id': '84'} Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:32.250870 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:32.251752 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.252833 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1a066d04-0b52-4f88-8080-136c1ef37a17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:32.253971 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1a066d04-0b52-4f88-8080-136c1ef37a17 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397968 Aug 11 09:53:32.253971 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Aug 11 09:53:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:32.260689 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-058f36d6-0739-498e-a08d-a71379fe5ab1 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:32.275242 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-058f36d6-0739-498e-a08d-a71379fe5ab1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018168 Aug 11 09:53:32.275810 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:53:32.284994 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-fc165b8c-45be-4f78-8445-3b46949d51f1 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:32.300499 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-fc165b8c-45be-4f78-8445-3b46949d51f1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018955 Aug 11 09:53:32.301043 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:53:32.310861 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-a1b5c43c-9ffd-40e3-947a-f030261efb00 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:32.316207 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.wsgi [None req-a1b5c43c-9ffd-40e3-947a-f030261efb00 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-a1b5c43c-9ffd-40e3-947a-f030261efb00 admin admin] Request method failure captured: Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept: application/json Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept-Encoding: gzip, deflate Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Connection: keep-alive Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Content-Length: 0 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Host: 10.222.0.17 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-System-Scope: None Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: User-Agent: python-novaclient Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Auth-Token: gAAAAABi9NGb0Lfx5O_fSUcw3sDeFOW4QuvldNL8zQjNUAUZNT7cK45aZUGzN4Vn9I4CGTpGQ-ADd8NBmdkNpRpXGUqRO_0gExmSkrbVrr6Pkp4vSxGxJsqQc4tbM0JZ1-4UO6u9W-myuK9a8cuM2oe5hPm6Ip8dvBBxwd1IIwI2h0wclhQ7J14 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Id: None Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Name: None Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Identity-Status: Confirmed Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Is-Admin-Project: True Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Id: default Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Name: Default Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Name: admin Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Role: admin,reader,member Aug 11 09:53:32.317885 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Roles: admin,reader,member Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant: admin Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Name: admin Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User: admin Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Id: default Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Name: Default Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Name: admin Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: method: > Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: exception: Flavor 84 could not be found. Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: action_args: {'id': '84'} Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:32.319299 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:32.320111 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:32.321782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-a1b5c43c-9ffd-40e3-947a-f030261efb00 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:32.323011 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-a1b5c43c-9ffd-40e3-947a-f030261efb00 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011961 Aug 11 09:53:32.323011 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Aug 11 09:53:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:33.280679 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-fc165b8c-45be-4f78-8445-3b46949d51f1 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:33.281700 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-fc165b8c-45be-4f78-8445-3b46949d51f1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 11 09:53:33.282084 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:33.802237 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-ae594dee-4243-4f26-a5a4-e955a18c3804 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:33.808403 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.wsgi [None req-ae594dee-4243-4f26-a5a4-e955a18c3804 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-ae594dee-4243-4f26-a5a4-e955a18c3804 admin admin] Request method failure captured: Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept: application/json Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Accept-Encoding: gzip, deflate Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Connection: keep-alive Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Content-Length: 0 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Host: 10.222.0.17 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Openstack-System-Scope: None Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: User-Agent: python-novaclient Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Auth-Token: gAAAAABi9NGd-LPuSHHks2R1CnQUdtezqCetySHb4yxff6no4P9-BflN0f6Q0lHRR1T-HWCsT1ZlfFqlm9HgzvrGyzpVuddOIhVxdecIYB6olOXDzjB_azlKiwEoagBIuy0Ykh5o32eYd0_dHDPmtaYKzZN969lwYZNG6dXgc3ZzXZVMYGUgfmI Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Id: None Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Domain-Name: None Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Identity-Status: Confirmed Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Is-Admin-Project: True Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Id: default Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Domain-Name: Default Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Project-Name: admin Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Role: admin,reader,member Aug 11 09:53:33.809924 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Roles: admin,reader,member Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant: admin Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-Tenant-Name: admin Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User: admin Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Id: default Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Domain-Name: Default Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: X-User-Name: admin Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: method: > Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: exception: Flavor 451 could not be found. Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: action_args: {'id': '451'} Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:33.811432 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:33.812366 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.813624 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-ae594dee-4243-4f26-a5a4-e955a18c3804 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:33.814805 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-ae594dee-4243-4f26-a5a4-e955a18c3804 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387862 Aug 11 09:53:33.814805 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:53:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:33.821453 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-461d82f5-fede-4b75-9bc6-02c56aad97f9 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:33.837277 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-461d82f5-fede-4b75-9bc6-02c56aad97f9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019911 Aug 11 09:53:33.837805 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:53:33.847294 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:33.862586 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018867 Aug 11 09:53:33.863175 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Aug 11 09:53:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 09:53:33.872405 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-70aafce6-3546-413e-811a-7aab5eb5a855 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:33.877718 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-70aafce6-3546-413e-811a-7aab5eb5a855 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-70aafce6-3546-413e-811a-7aab5eb5a855 admin admin] Request method failure captured: Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept: application/json Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Connection: keep-alive Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Content-Length: 0 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Host: 10.222.0.17 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.90 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABi9NGd-LPuSHHks2R1CnQUdtezqCetySHb4yxff6no4P9-BflN0f6Q0lHRR1T-HWCsT1ZlfFqlm9HgzvrGyzpVuddOIhVxdecIYB6olOXDzjB_azlKiwEoagBIuy0Ykh5o32eYd0_dHDPmtaYKzZN969lwYZNG6dXgc3ZzXZVMYGUgfmI Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Role: admin,reader,member Aug 11 09:53:33.879183 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Roles: admin,reader,member Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c055f43eb0f74f81a1a2e702ea1b7964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant: admin Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Id: c055f43eb0f74f81a1a2e702ea1b7964 Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User: admin Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Id: 7936a8595af344cb984e181520011d53 Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: X-User-Name: admin Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: method: > Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: exception: Flavor 451 could not be found. Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: action_args: {'id': '451'} Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:53:33.881240 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:33.882173 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Aug 11 09:53:33.883582 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-70aafce6-3546-413e-811a-7aab5eb5a855 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:53:33.884768 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-70aafce6-3546-413e-811a-7aab5eb5a855 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012160 Aug 11 09:53:33.884768 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:53:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 11 09:53:34.846232 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:34.847245 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 11 09:53:34.847644 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:35.374046 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-703a0e3e-a00f-4861-946c-13328a3de037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:35.467588 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-703a0e3e-a00f-4861-946c-13328a3de037 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.470894 Aug 11 09:53:35.468139 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Aug 11 09:53:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:53:36.422114 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:36.423112 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 11 09:53:36.423505 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:36.947760 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-86942349-be3f-4128-93bc-66231b497baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:37.061682 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-86942349-be3f-4128-93bc-66231b497baa admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.498094 Aug 11 09:53:37.062256 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Aug 11 09:53:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:53:38.038724 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:38.039722 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 11 09:53:38.040117 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 09:53:38.550157 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-c876761e-2b97-483e-9fa6-727b7e6d8f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:38.641306 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-c876761e-2b97-483e-9fa6-727b7e6d8f3b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464026 Aug 11 09:53:38.642014 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Aug 11 09:53:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:53:39.606377 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:39.607387 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 11 09:53:39.607782 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:40.124154 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-1d184845-4a33-4b6c-9d3c-a6cb1123c526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:53:40.210247 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-1d184845-4a33-4b6c-9d3c-a6cb1123c526 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.465460 Aug 11 09:53:40.210806 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Aug 11 09:53:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:53:41.172631 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:41.173655 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 11 09:53:41.174045 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:53:41.690340 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-455c5c66-c519-4b2a-aacc-d0a365d6bc7f admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:53:41.711165 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-455c5c66-c519-4b2a-aacc-d0a365d6bc7f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402183 Aug 11 09:53:41.711749 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Thu Aug 11 09:53:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:54:32.878334 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:32.879859 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-6516f809-2774-4573-9a0d-2cdd5ca7d944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Aug 11 09:54:32.880256 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Thu Aug 11 09:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:54:32.890705 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:54:33.273889 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-c4686315-a893-4c90-bc14-913beeeb3857 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:33.294266 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-c4686315-a893-4c90-bc14-913beeeb3857 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407958 Aug 11 09:54:33.294875 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Thu Aug 11 09:54:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:54:33.319263 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-cd32c8ba-cfef-4d5f-a0e5-2cc49b6a0fc8 admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:33.322761 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG dbcounter [-] [105893] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:54:33.327700 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-cd32c8ba-cfef-4d5f-a0e5-2cc49b6a0fc8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012634 Aug 11 09:54:33.328215 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Thu Aug 11 09:54:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:54:33.340189 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3a4f7341-4795-416f-9160-d0758b7890db admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:33.347835 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3a4f7341-4795-416f-9160-d0758b7890db admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011358 Aug 11 09:54:33.348354 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Thu Aug 11 09:54:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:54:33.359471 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:33.368010 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012022 Aug 11 09:54:33.368526 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Thu Aug 11 09:54:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:54:33.380291 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-15048653-31bc-4661-b5fd-17ebd1b01fca admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:54:33.388048 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-15048653-31bc-4661-b5fd-17ebd1b01fca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011861 Aug 11 09:54:33.388573 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Thu Aug 11 09:54:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:57:36.932006 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:36.938336 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 11 09:57:36.938336 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:57:37.074781 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=6 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:37.232842 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:37.238653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:37.239252 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:37.239515 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:37.274005 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-9b4020a5-892e-4503-878c-2474c0839313 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200669 Aug 11 09:57:37.274572 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:57:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:57:38.101198 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:38.102205 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 11 09:57:38.102602 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:57:38.294731 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:38.297685 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:57:38.297685 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:57:38.298947 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:38.299449 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:38.299875 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:38.300581 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:38.301044 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:38.301463 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:38.320337 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-a61e5010-f6ca-4c0c-b945-b1d407f4496c admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077160 Aug 11 09:57:38.320878 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:57:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 09:57:49.572495 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:49.573569 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 11 09:57:49.573966 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:57:49.719892 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell0:SELECT=4 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:49.720623 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell1:SELECT=4 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:49.721284 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=8 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:49.771159 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:49.773642 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:57:49.773642 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:57:49.774729 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:49.775201 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:49.775653 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:49.776356 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:49.776803 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:49.777249 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:49.802890 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-62d45775-4f50-4320-b222-71749b07f635 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087342 Aug 11 09:57:49.803378 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:57:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:57:50.620876 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: DEBUG nova.api.openstack.wsgi [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] Calling method '>' {{(pid=105893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:50.621922 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: INFO nova.api.openstack.requestlog [None req-02619d06-ca16-4fe3-9ec7-c70af7b4a0eb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 11 09:57:50.622348 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: [pid: 105893|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Aug 11 09:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:57:50.821184 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:57:50.823555 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:57:50.823555 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: warnings.warn(msg) Aug 11 09:57:50.824729 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:50.825233 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:50.825714 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:50.826356 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:57:50.826795 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:57:50.827252 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:57:50.849556 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-98a7407e-e060-44ce-8bfd-1728d5090f03 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082021 Aug 11 09:57:50.850096 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Aug 11 09:57:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 09:58:45.658530 dv-cinder-815660-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 11 09:58:45.659238 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: Thu Aug 11 09:58:45 2022 - graceful shutdown triggered... Aug 11 09:58:45.659694 dv-cinder-815660-9-iscsi devstack@n-api.service[105893]: Gracefully killing worker 1 (pid: 105893)... Aug 11 09:58:45.660112 dv-cinder-815660-9-iscsi devstack@n-api.service[105894]: Gracefully killing worker 2 (pid: 105894)... Aug 11 09:58:46.660398 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: worker 1 buried after 1 seconds Aug 11 09:58:46.660958 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: worker 2 buried after 1 seconds Aug 11 09:58:46.660958 dv-cinder-815660-9-iscsi devstack@n-api.service[105892]: goodbye to uWSGI. Aug 11 09:58:46.661943 dv-cinder-815660-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 11 09:58:46.662493 dv-cinder-815660-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 11 09:58:46.665370 dv-cinder-815660-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 09:58:46.675871 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 09:58:46 2022] *** Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: nodename: dv-cinder-815660-9-iscsi Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: machine: x86_64 Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: clock source: unix Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: pcre jit disabled Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: detected number of CPU cores: 4 Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: current working directory: / Aug 11 09:58:46.677972 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: detected binary path: /usr/bin/uwsgi-core Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: your processes number limit is 47680 Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: your memory page size is 4096 bytes Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: detected max file descriptor number: 2048 Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: lock engine: pthread robust mutexes Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: thunder lock: enabled Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 09:58:46.678637 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 09:58:46.719948 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: Python main interpreter initialized at 0x55af335409c0 Aug 11 09:58:46.719948 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: python threads support enabled Aug 11 09:58:46.719948 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: your server socket listen backlog is limited to 100 connections Aug 11 09:58:46.719948 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: your mercy for graceful operations on workers is 90 seconds Aug 11 09:58:46.720449 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 09:58:46.720449 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: *** Operational MODE: preforking *** Aug 11 09:58:46.720668 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: *** uWSGI is running in multiple interpreter mode *** Aug 11 09:58:46.720668 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: spawned uWSGI master process (pid: 121181) Aug 11 09:58:46.720874 dv-cinder-815660-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 09:58:46.725079 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: spawned uWSGI worker 1 (pid: 121196, cores: 1) Aug 11 09:58:46.725079 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: spawned uWSGI worker 2 (pid: 121197, cores: 1) Aug 11 09:58:46.725079 dv-cinder-815660-9-iscsi devstack@n-api.service[121181]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 09:58:47.387098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 09:58:47.390092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 09:58:48.547179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:58:48.547179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: from cryptography.utils import int_from_bytes Aug 11 09:58:48.547831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:58:48.547831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: from cryptography.utils import int_from_bytes Aug 11 09:58:48.566039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:58:48.566039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: from cryptography.utils import int_from_bytes Aug 11 09:58:48.566606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:58:48.566606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: from cryptography.utils import int_from_bytes Aug 11 09:58:50.870785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:58:50.871355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:58:50.871629 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:58:50.871933 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:58:50.872196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:58:50.872585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.872912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.873263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.873588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.873922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.874237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.874561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.874874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.875208 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.875473 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.875788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.876115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-9-iscsi {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.876451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.876749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.877080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.877405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.878406 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.878791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.879107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.879624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.881618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.882008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.882400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.882693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.882919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.883330 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-9-iscsi {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.883583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.883877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.884177 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.884585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.884903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.885239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.885586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.885885 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.886197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.886559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.886871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.887188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.887512 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.887818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.888129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.888444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.888772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.889102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.889414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.889664 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.889982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.890306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.890632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.890958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.891213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.891465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.891789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.892115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.892426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.892737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.893067 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.893979 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.894236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.894547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.894855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.895166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.895487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.895807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.896130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.896443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.896765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.897198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.897445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.897758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.898100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.898432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.898737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.899062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.899384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.899694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.900003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.900312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.900634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.900971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.901301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.901556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.901861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.902169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.902492 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.902799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.903108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.903417 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.903719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.904047 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.905882 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.906135 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.906445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.906762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.907084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.907395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.907704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.908010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.908320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.908653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.909169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.909339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.909615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.909925 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.910233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.910580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.910965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.911164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.911489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.911799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.912099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.912421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.912728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.913074 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.913402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.913659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.913966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.914299 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.914575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.914881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.915179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.915499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.915826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.916182 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.916450 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.916736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.917076 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.922659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.923846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.925891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.927066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.928963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.930503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.930503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.930503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.930503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.930503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.931233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.931233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.931513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.932079 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.932079 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.932393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.932634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.932796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:58:50.933487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.933646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:58:50.933797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.933797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.934076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:58:50.934226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.934367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:58:50.934508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.934655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:58:50.934841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.935002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.935145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.935305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.935455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.935597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.935745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.935900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.936050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.936200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.936341 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.936489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.936646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.936788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.936937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.937110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.937267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.937267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.937597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.937597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.937980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.937980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.938269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.938421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.938690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-9-iscsi {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.938893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.939040 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.939189 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.939340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.939510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.939652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.939800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.939980 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.941056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.941212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.941410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.941567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.941567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.941884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.942353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.942549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.942702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.942850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.943001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.943176 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.943323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.943549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.943697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.943849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.943990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.944130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.944271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.944421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.944588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.944731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.944872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.945029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.945212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.945376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.945531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.945681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.945681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.945948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-9-iscsi {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.946099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.946251 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.946403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.946546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.946694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.946850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.947032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.947179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.947352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.947497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.947639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.947793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.947953 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.948758 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.948919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.949132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.949282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.949507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.949655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.949798 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.949939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.950081 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.950240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.950240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.950520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.950663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.951202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.951360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.951528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.951680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.951825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.951972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.952137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.952643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.952797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.952949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.953115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.953115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.953405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.953587 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.953754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.953943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.954087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.954229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.954369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.954523 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.954672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.954822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.955050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.955210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.955362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.955511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.955762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.956425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.956580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.956722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.956872 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.957082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.957245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.957395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.957643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.957790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.957931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.958080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.958235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.958395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.958544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.958685 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.958889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.959051 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.959193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.959342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.959524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.959672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.959820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.959987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.960137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.960300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.960449 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.960600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.960748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.960917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.961425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.961425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.962045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.962045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.962422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.962831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.962976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.963159 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.963325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.963476 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.963660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.963817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.963959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.964100 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.964247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.964247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.964526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.964675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.964818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.964818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.965136 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.965290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.965444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.965444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.965804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.965957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.966110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.966259 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.966413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.966413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.966696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.966838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.966985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.967126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.967285 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.967436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.967585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.967725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.967866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.968015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.970603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.970760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.970917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.971063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.971682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.971981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.972146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.972306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.972536 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.972957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.973132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.973292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.973436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.973586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.973773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.973962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.974112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.974265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.974448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.974622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.974766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.974916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.975068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.975211 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.975352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.975500 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.975643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.975785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.975937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.975937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.976221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.976363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.976514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.976663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.976814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.976958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.977135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.977294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.977443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.977592 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.977741 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.978508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.978669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.978669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.979549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.979705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.979849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.979849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.980134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.980489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.980787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.980787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.982186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.982362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.982618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.982804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.983192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.983351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.983502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.983652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.983794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.983946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.984089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.984231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.984381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.984549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.984829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.985069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.985230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.985374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.985524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.985674 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.985828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.985978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.986127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.986269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.986411 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.986560 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.986726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.986893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.987056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.987199 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:58:50.987349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.987492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.987682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.987839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.987989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.988883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.989997 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.990984 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.991237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.991409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.991643 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.992923 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.993353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.993535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.993705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.993925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.994877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.995899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.996196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.996338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.996576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.996753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.996907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.997067 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.997622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.997767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.997939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998272 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.998902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:50.999939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.000888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.001067 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.001227 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.001370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.001520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.001765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.002192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.002356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.003092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.004938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.005959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.006877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.007913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008054 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.008934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009106 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.009996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.010146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.010301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.010457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.011229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.011392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.011639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.011877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.012049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.012470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.012622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.012772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.012921 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.013140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.013367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.013595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.013849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.014003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.014262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.014412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.014564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.014722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015025 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.015980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.016276 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.016431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.016592 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.016750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.016906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.017927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.018091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.018875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019423 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.019875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.020910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.021143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.021308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.021465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.021614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.021780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.022058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.022226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.023169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.023355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.023613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.023866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.024122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.024970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.025943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026102 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.026875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027557 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.027864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.028996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.029943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.030100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.030296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.030452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.030620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.030823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031325 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.031944 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.032187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.032351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.032812 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.032980 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.033203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.033364 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.033520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.033785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.034044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.034319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.034595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.034767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.034944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.035982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.036942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.037113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.037281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.037665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.037841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.038974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039308 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039616 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.039947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040102 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040276 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.040936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.041265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.041265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.041561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.041720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.041877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.042027 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.042273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.042452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.042707 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.043167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.043320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.043470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.043626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.043791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044687 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.044994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.045306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.045473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.045630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.045780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.045927 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.046082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.046850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.047979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.048909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.049086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.049242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.049939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.050887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051180 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.051955 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.052185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.052432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.052597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.052866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.053280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.053453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.053605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.053761 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.053917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.054156 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.054391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.054577 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.054827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.054827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.055254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.055498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.055666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.055666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.055967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.056123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.056272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.056272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.056688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.056861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057490 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.057977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.058890 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.059990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.060905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.061805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.062115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.062115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.062495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.062653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.062926 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.063093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.063093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.063596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.063754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.063904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.064060 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.064305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.064549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.064715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.064963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.065567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.065734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.065895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.066951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067101 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.067870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.068835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069006 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069344 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.069969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.070155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.070361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.070538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.070688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.070868 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.071958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.072115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.072271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.072642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.072838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.073096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.073254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.073585 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.073757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.073923 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.074080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.074237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.074470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.074707 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.074873 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.075120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.075284 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.075434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.075584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.075840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076012 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.076860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.077894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.078182 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.078351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.078507 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.078701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.078866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079030 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.079839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.080000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.080150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.080298 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.080465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.081308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.081499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.081659 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.081809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.081959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.082107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.082255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.082413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.082562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.083241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.083418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.083731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.083886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.084050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.084207 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.084357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.084606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.084865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.085223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.085472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.085625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.085875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.086034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.086034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.086348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.086508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087170 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.087936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.088949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.089925 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090081 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.090883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.091958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.092897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.093098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.093337 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.093497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.093789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.093962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.094113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.094261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.094410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.094641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.094800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.095090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.095272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.095518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.095681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.095832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.096083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.096321 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.097149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.097385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.097547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.097698 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.097847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.098893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.099972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.100952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.101939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.102911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.103066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.103222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.103389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.103621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.103930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104735 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.104954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.105154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.105305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.105454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.105711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.105876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.106916 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107525 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.107988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.108993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.109191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.109342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.109498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.109751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.109909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.110883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.111053 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.111221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.111407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.111571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.111738 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.112607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.112820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.112974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.113156 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.113336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.113486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.113726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.114835 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115531 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115843 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.115992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.116158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.116342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.116505 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.116758 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.117349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.117525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.117688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.118207 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.118374 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.118533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.119430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.119609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.120724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.120895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121392 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.121870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122168 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.122970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123268 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123582 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.123972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.124281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.124450 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.124607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.124756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.124756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.125967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.126125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.126274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.126436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.126593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.126767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.127016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.127206 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.127373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.127566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.128332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.128503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.128503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.128946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.129164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.129408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.129566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.129993 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.130931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131238 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.131862 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132012 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.132858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.133974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.134218 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.134544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.134696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.134845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.134994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.135153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.135399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.135563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.135714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.135863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.136952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.137970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.138907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139630 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.139954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140264 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.140892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141073 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141236 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141558 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.141913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.142990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.143570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.143749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.143910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.144075 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.144663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.145914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.146235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.146235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.146528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.146693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.146844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147760 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.147910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148220 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.148857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.149960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.150851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151616 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.151765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152690 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.152847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153006 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.153990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.154166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.154319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.154863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155186 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.155844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.156003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.156153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.156316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.156467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.156980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.157948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.158943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.159095 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.159286 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.159452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.159610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.159610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160819 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.160969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.161846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.162892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.163568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.164459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.165977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.166866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.167920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.168939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.169484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.170561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.171555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.172672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.173080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.173459 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.173769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.174080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.174898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.175268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.175589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.175943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.176269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.176586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.176901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.177244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.177557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.177868 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.178179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.178488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.178803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.179137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.179457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.179762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.180202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.180519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.184853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.186879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.189444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.190134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.191091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.191172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.191576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.191895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.192202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.192507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.192815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.193260 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.193600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.193919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.194244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.194557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.195075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.195265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.195493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.195815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.196328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.196521 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.196752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.197092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.197404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.197714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.198024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.198334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.198644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.198979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.199312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.199619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.199946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.200265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.200587 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.200902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.201240 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.201575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.201898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.202203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.202512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.202822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.203132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.203448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.203760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.204070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.204388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.204705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.205294 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.205478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.205749 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.206303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.206734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.207001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.207315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.207662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.207990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.208303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.208614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.208919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:58:51.209193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:58:51.285757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO dbcounter [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Registered counter for database nova_api Aug 11 09:58:51.306617 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_db.sqlalchemy.engines [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.313132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writer thread running {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.357978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO dbcounter [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Registered counter for database nova_api Aug 11 09:58:51.370215 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.context [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae211188-ecfc-4a58-9f59-b381cd08d799(cell1) {{(pid=121196) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 09:58:51.374199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:58:51.374672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:58:51.376292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:58:51.377097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:58:51.377608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:58:51.377933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.379618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:58:51.381655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO dbcounter [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Registered counter for database nova_cell0 Aug 11 09:58:51.384376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writer thread running {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.385767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO dbcounter [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Registered counter for database nova_cell1 Aug 11 09:58:51.393643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_db.sqlalchemy.engines [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.395853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_db.sqlalchemy.engines [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.400925 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writer thread running {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.406128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writer thread running {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.441428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.context [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae211188-ecfc-4a58-9f59-b381cd08d799(cell1) {{(pid=121197) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 09:58:51.445480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:58:51.445951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:58:51.447531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:58:51.448283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:58:51.448727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:58:51.450728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:58:51.452700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO dbcounter [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Registered counter for database nova_cell0 Aug 11 09:58:51.457701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO dbcounter [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Registered counter for database nova_cell1 Aug 11 09:58:51.465789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.467543 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.473196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writer thread running {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.549838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO dbcounter [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Registered counter for database nova_cell0 Aug 11 09:58:51.556446 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_db.sqlalchemy.engines [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.560779 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writer thread running {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.615188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writer thread running {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.624450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO dbcounter [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Registered counter for database nova_cell0 Aug 11 09:58:51.631802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:58:51.636545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writer thread running {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:58:51.882316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: WARNING keystonemiddleware.auth_token [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:58:51.889685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: WARNING keystonemiddleware.auth_token [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:58:51.955127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: WARNING keystonemiddleware.auth_token [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:58:51.963081 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: WARNING keystonemiddleware.auth_token [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:58:52.234780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: WARNING keystonemiddleware.auth_token [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:58:52.241247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: WARNING keystonemiddleware.auth_token [None req-602a6033-8c33-47ad-8e85-af2559b4b949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:58:52.247673 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af335409c0 pid: 121196 (default app) Aug 11 09:58:52.308357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: WARNING keystonemiddleware.auth_token [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 09:58:52.314421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: WARNING keystonemiddleware.auth_token [None req-a3a13c39-a5dc-4404-93a3-df0978fa80aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 09:58:52.321351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af335409c0 pid: 121197 (default app) Aug 11 09:59:28.695612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:28.697326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:28.698457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:28.699255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:29.865980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8a3cbf84-9362-4ea5-b9e5-7f07bef8bc45 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Action: 'create', calling method: .version_select at 0x7f787e1fbdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-937552087"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:32.251745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8a3cbf84-9362-4ea5-b9e5-7f07bef8bc45 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.534501 Aug 11 09:59:32.251745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Aug 11 09:59:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3539 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 11 09:59:32.262847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.262847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.262847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.262847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.700345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c2bfb099-ad72-4302-b67d-5d50727d6506 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e268af0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:34.061146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c2bfb099-ad72-4302-b67d-5d50727d6506 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 200 len: 345 microversion: 2.1 time: 1.830821 Aug 11 09:59:34.061845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 09:59:32 2022] GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 345 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:34.075604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-97885b24-b4b9-4b70-b666-75df69d26ad1 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Action: 'create', calling method: .version_select at 0x7f787e073b80>, body: {"snapshot": {"volume_id": "6e42f845-cb7c-4696-be52-bf123818da21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1467766641"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:34.878657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-97885b24-b4b9-4b70-b666-75df69d26ad1 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.807761 Aug 11 09:59:34.879548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1162 bytes} [Thu Aug 11 09:59:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:34.898958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b3a6b050-561b-421e-b787-9e7709426318 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e0ada60>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:35.019619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b3a6b050-561b-421e-b787-9e7709426318 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.132815 Aug 11 09:59:35.020187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:34 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:35.033893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-aa9449b4-3c8c-45b1-abfd-dd0696dedc0f tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e086d30>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:35.121509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-aa9449b4-3c8c-45b1-abfd-dd0696dedc0f tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.094124 Aug 11 09:59:35.122396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1140 bytes} [Thu Aug 11 09:59:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 09:59:35.140314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a7eade8c-e7cc-49c7-a90f-61669ccbb7c6 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e06d3a0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:35.207435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a7eade8c-e7cc-49c7-a90f-61669ccbb7c6 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.077197 Aug 11 09:59:35.215785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:35 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:36.221973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d3d88fc1-326d-4cf9-af24-4d7c2bb24e57 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e086af0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:36.276883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d3d88fc1-326d-4cf9-af24-4d7c2bb24e57 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.059715 Aug 11 09:59:36.278007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:36 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:37.291725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-06797a3c-7fbc-484f-8596-86318cd6132a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e06da60>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:37.341206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-06797a3c-7fbc-484f-8596-86318cd6132a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.049550 Aug 11 09:59:37.341206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:37 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:38.349407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5826c614-9a2b-44d4-a12a-02730dec6c2e tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e086550>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:38.409301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5826c614-9a2b-44d4-a12a-02730dec6c2e tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.063653 Aug 11 09:59:38.410346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:38 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:39.424317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0768026b-865e-43e5-ad58-9c5788b5bced tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e0adca0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:39.508319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0768026b-865e-43e5-ad58-9c5788b5bced tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 288 microversion: 2.1 time: 0.089859 Aug 11 09:59:39.509144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:39 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:39.521732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1fa2ddb0-42d0-4fe7-bf45-7fb10fc35eed tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e073e50>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:39.798958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1fa2ddb0-42d0-4fe7-bf45-7fb10fc35eed tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 202 len: 0 microversion: 2.1 time: 0.282677 Aug 11 09:59:39.799518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1254 bytes} [Thu Aug 11 09:59:39 2022] DELETE /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 09:59:39.808235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f99e8989-72df-4e95-8dd9-fb3db4d7f9d7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e06daf0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:39.845380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f99e8989-72df-4e95-8dd9-fb3db4d7f9d7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.041401 Aug 11 09:59:39.849095 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:39 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:40.870209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-379e7121-8edd-44f8-ad1e-d2d60d8ae4c7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e073dc0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:40.956626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-379e7121-8edd-44f8-ad1e-d2d60d8ae4c7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.101761 Aug 11 09:59:40.957470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:40 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:41.971002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-09759b33-b35c-4240-9bfb-3719f92d6c45 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e06d3a0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:42.065087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-09759b33-b35c-4240-9bfb-3719f92d6c45 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 200 len: 287 microversion: 2.1 time: 0.099164 Aug 11 09:59:42.070631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:41 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:43.079720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-959a64d1-700c-4660-bdf0-588433d3671a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e086280>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:43.163031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-959a64d1-700c-4660-bdf0-588433d3671a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] HTTP exception thrown: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-959a64d1-700c-4660-bdf0-588433d3671a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Request method failure captured: Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 HTTP/1.1 Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMA9nliiwZbOrZguHo7XeEiYVDtO7cAU__kethQsC-gkcBxbJvlkRzUMEKLusSLTrqOyDYhHme7U8S92akL5-U3jGDgPfUMrVAXjZttLjHkfnADt1ZwG08Us8MScGOU-NCe1-J9gS-8Dr9meQI-3DshrBIiFhsw51mDCk6hAvaKHVM Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 09:59:43.171428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: c562afc432404b25bbd49dee793a8ce8 Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649'} Aug 11 09:59:43.173056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. (HTTP 404) (Request-ID: req-3b5e1af2-769f-45bb-9d7d-d7d633032150) Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.173689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:43.174621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 11 09:59:43.175486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-959a64d1-700c-4660-bdf0-588433d3671a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Returning 404 to user: Snapshot 4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:59:43.176375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-959a64d1-700c-4660-bdf0-588433d3671a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649" status: 404 len: 111 microversion: 2.1 time: 0.099993 Aug 11 09:59:43.190952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Aug 11 09:59:43 2022] GET /compute/v2.1/os-snapshots/4d1a9cc1-04a4-4afa-8bf5-1d13b30d6649 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 09:59:43.229475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-20947206-57c6-495a-a88a-706718acb50c tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e088790>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:43.396769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bd138c7d-c1eb-4e23-af7f-8e48165cd989 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: .version_select at 0x7f787e0ada60>, body: {"keypair": {"name": "tempest-keypair-594233852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2wKQipjAH2ER+gX8ASrhwRsgZ2X9ABETrqy09NVWndJWKz1Bz4/flQPP/3tZ3tp2u6omp2qWmqadZ1OJjnAP5DFLc3axDDDsjbfzBnVxVc/j0Ve9TlE9Q4tlX20nA/IA=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:43.513262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-bd138c7d-c1eb-4e23-af7f-8e48165cd989 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for project 90177d2267614a389ae39922cba114e2. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:43.545285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-bd138c7d-c1eb-4e23-af7f-8e48165cd989 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for user d6c2fc568ee74d35bba01c6ce294edeb and project 90177d2267614a389ae39922cba114e2. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:43.559620 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-20947206-57c6-495a-a88a-706718acb50c tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 202 len: 0 microversion: 2.1 time: 0.359890 Aug 11 09:59:43.564811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 09:59:43 2022] DELETE /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 09:59:43.571667 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3d39cd8f-8395-4863-8b94-410e308b57da tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e088dc0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:43.763019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bd138c7d-c1eb-4e23-af7f-8e48165cd989 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.680033 Aug 11 09:59:43.763950 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 8/17] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 09:59:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:43.804037 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3d39cd8f-8395-4863-8b94-410e308b57da tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 200 len: 344 microversion: 2.1 time: 0.237167 Aug 11 09:59:43.804037 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 10/18] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 09:59:43 2022] GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:43.918357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-130fe329-0c26-4bef-a439-c8dff2998e20 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: .version_select at 0x7f787e059940>, body: {"keypair": {"name": "tempest-keypair-1312777794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON+K7Ko3G6XTEtKM/9ww8uOqK8R1uxSvJdMsuldq6fBsGR6I8SuNNEt2DwVo9cJLv46eGvyIISsEiEA67EX5Ygl+lkG4vM3jS+ZOXDep1MJMlQ21ItdqV4LONXy9JW7dQ=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:43.957066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-130fe329-0c26-4bef-a439-c8dff2998e20 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:43.982792 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-130fe329-0c26-4bef-a439-c8dff2998e20 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:44.134269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-130fe329-0c26-4bef-a439-c8dff2998e20 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.359420 Aug 11 09:59:44.134269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 9/19] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 09:59:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:44.818811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5deb0c1e-4836-457a-8935-2eb1f30aea7a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787d8068b0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:44.878844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-5deb0c1e-4836-457a-8935-2eb1f30aea7a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] HTTP exception thrown: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5deb0c1e-4836-457a-8935-2eb1f30aea7a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Request method failure captured: Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 HTTP/1.1 Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMA9nliiwZbOrZguHo7XeEiYVDtO7cAU__kethQsC-gkcBxbJvlkRzUMEKLusSLTrqOyDYhHme7U8S92akL5-U3jGDgPfUMrVAXjZttLjHkfnADt1ZwG08Us8MScGOU-NCe1-J9gS-8Dr9meQI-3DshrBIiFhsw51mDCk6hAvaKHVM Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 09:59:44.885161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: c562afc432404b25bbd49dee793a8ce8 Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '6e42f845-cb7c-4696-be52-bf123818da21'} Aug 11 09:59:44.886401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. (HTTP 404) (Request-ID: req-9da2d745-8564-4298-8712-54ef75917780) Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.887049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:44.887929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 09:59:44.892998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5deb0c1e-4836-457a-8935-2eb1f30aea7a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Returning 404 to user: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5deb0c1e-4836-457a-8935-2eb1f30aea7a tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 404 len: 109 microversion: 2.1 time: 0.072314 Aug 11 09:59:44.895537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 09:59:44 2022] GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 09:59:44.914949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a390344b-f381-4f40-984b-827798ce99cb tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787e9fe1f0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:44.986872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-a390344b-f381-4f40-984b-827798ce99cb tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] HTTP exception thrown: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a390344b-f381-4f40-984b-827798ce99cb tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Request method failure captured: Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 HTTP/1.1 Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMA9nliiwZbOrZguHo7XeEiYVDtO7cAU__kethQsC-gkcBxbJvlkRzUMEKLusSLTrqOyDYhHme7U8S92akL5-U3jGDgPfUMrVAXjZttLjHkfnADt1ZwG08Us8MScGOU-NCe1-J9gS-8Dr9meQI-3DshrBIiFhsw51mDCk6hAvaKHVM Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 09:59:44.989599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: c562afc432404b25bbd49dee793a8ce8 Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '6e42f845-cb7c-4696-be52-bf123818da21'} Aug 11 09:59:44.990710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. (HTTP 404) (Request-ID: req-1f5d011a-b5db-47f1-ab1f-1631ca0e991e) Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.991345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 09:59:44.992363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 09:59:44.998215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a390344b-f381-4f40-984b-827798ce99cb tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Returning 404 to user: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a390344b-f381-4f40-984b-827798ce99cb tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 404 len: 109 microversion: 2.1 time: 0.098741 Aug 11 09:59:44.999460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 09:59:44 2022] DELETE /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 09:59:45.004771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2098606387", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:45.005287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-862b1054-ebc4-489b-87c8-8a3605cc11f7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Calling method '.version_select at 0x7f787d806c10>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:45.098373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-862b1054-ebc4-489b-87c8-8a3605cc11f7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] HTTP exception thrown: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-862b1054-ebc4-489b-87c8-8a3605cc11f7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Request method failure captured: Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 HTTP/1.1 Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMA9nliiwZbOrZguHo7XeEiYVDtO7cAU__kethQsC-gkcBxbJvlkRzUMEKLusSLTrqOyDYhHme7U8S92akL5-U3jGDgPfUMrVAXjZttLjHkfnADt1ZwG08Us8MScGOU-NCe1-J9gS-8Dr9meQI-3DshrBIiFhsw51mDCk6hAvaKHVM Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 09:59:45.103533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33671f24dbc4478682f5e7b090bf48fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 33671f24dbc4478682f5e7b090bf48fa Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1245955731 Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: c562afc432404b25bbd49dee793a8ce8 Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1245955731-project Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '6e42f845-cb7c-4696-be52-bf123818da21'} Aug 11 09:59:45.104763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. (HTTP 404) (Request-ID: req-f8520115-018c-4f8e-9a59-8bd24ea6e05d) Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:45.105719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 09:59:45.107054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 09:59:45.108262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. Aug 11 09:59:45.109407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 09:59:45.112277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-862b1054-ebc4-489b-87c8-8a3605cc11f7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] Returning 404 to user: Volume 6e42f845-cb7c-4696-be52-bf123818da21 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 09:59:45.112833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-862b1054-ebc4-489b-87c8-8a3605cc11f7 tempest-VolumesSnapshotsTestJSON-1245955731 tempest-VolumesSnapshotsTestJSON-1245955731-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21" status: 404 len: 109 microversion: 2.1 time: 0.111940 Aug 11 09:59:45.114113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 12/22] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 09:59:44 2022] GET /compute/v2.1/os-volumes/6e42f845-cb7c-4696-be52-bf123818da21 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 09:59:45.157225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] validate_networks() for [('077e1416-1a08-4f10-a088-a425d2677f36', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 09:59:47.919209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2137633", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "networks": [{"uuid": "8d20381d-e95c-43a2-82b0-faab9a100b0b"}]}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:48.142301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] validate_networks() for [('8d20381d-e95c-43a2-82b0-faab9a100b0b', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 09:59:48.230734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 09:59:48.233226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 09:59:48.233957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 09:59:48.234524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 09:59:48.235125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 09:59:48.270352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:48.273441 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:48.277294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:48.285380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:48.288671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:48.291542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:48.426772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:48.454987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for user c62f05ea732142c1af1c09dd23e7b9a3 and project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:48.476883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 09:59:48.481158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 09:59:48.768329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1859e94f-14f5-4586-a711-fc2f6b908722 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.959521 Aug 11 09:59:48.769260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 11/23] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 09:59:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 09:59:48.786311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-dc462b8a-3e8e-4aed-a7d9-9f400418c968 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:48.798471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-dc462b8a-3e8e-4aed-a7d9-9f400418c968 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:48.946483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-dc462b8a-3e8e-4aed-a7d9-9f400418c968 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:48.978109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-dc462b8a-3e8e-4aed-a7d9-9f400418c968 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1222 microversion: 2.1 time: 0.198701 Aug 11 09:59:48.978697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:48 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:49.639811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-631265946", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:49.788625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] validate_networks() for [('077e1416-1a08-4f10-a088-a425d2677f36', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 09:59:50.620042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 09:59:50.620710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 09:59:50.621730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 09:59:50.622150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 09:59:50.622757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 09:59:50.649941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:50.650443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:50.650877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:50.655886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:50.658557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:50.662997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:50.742810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Getting quotas for project 9f6ae51a6843404299c66e97cec51fec. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:50.767219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Getting quotas for user bf9353bc130d45a99af9386ff9dd9a2f and project 9f6ae51a6843404299c66e97cec51fec. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:50.814028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 09:59:50.819917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 09:59:50.934874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 09:59:50.935437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 09:59:50.936029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 09:59:50.936548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 09:59:50.937150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 09:59:50.966967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:50.966967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:50.967193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:50.980065 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:50.980667 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:50.981145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:51.068209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:51.073715 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for user c62f05ea732142c1af1c09dd23e7b9a3 and project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:51.119657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 09:59:51.129315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 09:59:51.145888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ac727309-8f46-487b-87d0-73013f77e616 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.411843 Aug 11 09:59:51.147840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 13/25] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 09:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 09:59:51.175278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1107809412", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0a83679-e7d2-4fa4-ab76-ec21cc24e038"}], "security_groups": [{"name": "tempest-securitygroup--1177122828"}], "key_name": "tempest-keypair-594233852", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:51.435034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-90c3793f-1d58-40a9-b747-47716563249d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.799325 Aug 11 09:59:51.446103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 13/26] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 09:59:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 09:59:51.457086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-30dd0c94-fdff-417b-838f-eeddbf63bc55 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:51.457712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-30dd0c94-fdff-417b-838f-eeddbf63bc55 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:51.619180 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] validate_networks() for [('b0a83679-e7d2-4fa4-ab76-ec21cc24e038', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 09:59:51.620716 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-30dd0c94-fdff-417b-838f-eeddbf63bc55 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:51.639012 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-30dd0c94-fdff-417b-838f-eeddbf63bc55 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1212 microversion: 2.1 time: 0.191732 Aug 11 09:59:51.652946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:51 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1212 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:51.659583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1731846451", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d20a0340-e393-4428-8a14-1335a616fcac"}], "security_groups": [{"name": "tempest-securitygroup--1525929973"}], "key_name": "tempest-keypair-1312777794", "user_data": "}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 09:59:51.931823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] validate_networks() for [('d20a0340-e393-4428-8a14-1335a616fcac', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 09:59:53.051172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 09:59:53.051172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 09:59:53.051172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 09:59:53.051172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 09:59:53.052048 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 09:59:53.070378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.074080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.079515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.079515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.079515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.080736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.085795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 09:59:53.086890 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 09:59:53.088303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 09:59:53.089027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 09:59:53.089725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 09:59:53.118566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.119469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.120166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.121182 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.123254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.123797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.153666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for project 90177d2267614a389ae39922cba114e2. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:53.166381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for user d6c2fc568ee74d35bba01c6ce294edeb and project 90177d2267614a389ae39922cba114e2. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:53.173386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 09:59:53.180405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 09:59:53.194596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 09:59:53.196785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 09:59:53.198258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 09:59:53.203733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 09:59:53.428475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-96c1dd95-81a2-4914-ae42-fe770ec1b2e3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.277663 Aug 11 09:59:53.432213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0859d3fc-3bdb-4c61-bfc0-5d6846079164 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.778097 Aug 11 09:59:53.432518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 14/28] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 09:59:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 09:59:53.433392 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 15/29] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 09:59:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 09:59:53.445083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:53.445957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:53.454893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.455470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.456069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:53.456849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.457961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.458072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:53.458850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.476457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.501747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.504127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.505473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.508721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:53.510026 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:53.512573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:53.856937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:53.905228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2c6d39a2-f3df-4518-83ff-35acb853685d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1216 microversion: 2.1 time: 0.470508 Aug 11 09:59:53.925677 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 16/30] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:53 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1216 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:53.944064 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d342e45e-5be5-49bf-8242-6f98e7b2ec71 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:53.948755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d342e45e-5be5-49bf-8242-6f98e7b2ec71 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:54.011573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:54.054004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7ae95366-b683-4458-b932-2557655d5c51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1225 microversion: 2.1 time: 0.619440 Aug 11 09:59:54.057371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 15/31] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:53 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1225 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:54.075660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-341eecfa-1ed9-404f-aa4d-32171295b1c5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:54.080084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d342e45e-5be5-49bf-8242-6f98e7b2ec71 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:54.080218 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-341eecfa-1ed9-404f-aa4d-32171295b1c5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:54.086118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d342e45e-5be5-49bf-8242-6f98e7b2ec71 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1237 microversion: 2.1 time: 0.159203 Aug 11 09:59:54.088310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 17/32] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:53 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1237 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:54.201121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-341eecfa-1ed9-404f-aa4d-32171295b1c5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:54.221337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-341eecfa-1ed9-404f-aa4d-32171295b1c5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1242 microversion: 2.1 time: 0.160249 Aug 11 09:59:54.236699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 16/33] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:54 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1242 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:54.934050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:54.940598 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:54.959796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:54.960321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:54.960759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:54.961511 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:54.961969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:54.962644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:55.077080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:55.078573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:55.093107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:55.093601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:55.095621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:55.097442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:55.105230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:55.107167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:55.137702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:55.176687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4505f450-1447-42c2-a936-ee368215842b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1264 microversion: 2.1 time: 0.245307 Aug 11 09:59:55.178700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 18/34] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:54 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:55.194368 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1ccf9c76-554f-43fe-8c73-1ab4471a3321 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:55.195342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1ccf9c76-554f-43fe-8c73-1ab4471a3321 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:55.295504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:55.311561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ed2f3442-2984-4b47-a276-e2059b2b09f7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1273 microversion: 2.1 time: 0.238677 Aug 11 09:59:55.312932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 17/35] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:55 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:55.317833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-34e0bed3-57cb-4092-bc71-590e73127313 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:55.321318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-34e0bed3-57cb-4092-bc71-590e73127313 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:55.356543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1ccf9c76-554f-43fe-8c73-1ab4471a3321 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:55.369861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1ccf9c76-554f-43fe-8c73-1ab4471a3321 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1237 microversion: 2.1 time: 0.187292 Aug 11 09:59:55.369861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 19/36] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:55 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:55.415409 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-34e0bed3-57cb-4092-bc71-590e73127313 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:55.423512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-34e0bed3-57cb-4092-bc71-590e73127313 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1242 microversion: 2.1 time: 0.109195 Aug 11 09:59:55.433889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 18/37] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:55 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:56.206173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:56.206818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:56.215944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.216438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.216880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.217634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.220457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.220954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.338105 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:56.338595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:56.360664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.365879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.366574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.369946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.370611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.376898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.608152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:56.620239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5dcb0487-abc5-487c-89db-de19c0d84038 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1272 microversion: 2.1 time: 0.418767 Aug 11 09:59:56.638906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:56 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1272 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:56.653421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:56.656789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:56.665283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.665963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.666566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.667425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.668078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.668717 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.694567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:56.702136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ce5cdad1-0979-4681-b48f-e9d7c053c6ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1281 microversion: 2.1 time: 0.369023 Aug 11 09:59:56.702733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:56 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:56.739720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:56.740421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:56.750799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.757863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.758683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.759599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:56.761639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:56.762228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:56.794592 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:56.804715 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7f8523ca-8b27-40ac-bce1-fc6d8ec21f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1241 microversion: 2.1 time: 0.161374 Aug 11 09:59:56.810081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 21/40] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:56 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:56.935746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:56.944987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-63156e01-cce6-435d-864f-d9a2ab5024f1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1294 microversion: 2.1 time: 0.217462 Aug 11 09:59:56.965408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:56 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1294 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:57.056592 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c51e334b-ec4f-490e-aa72-362440540ff0 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787cdfd700>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:57.182208 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c51e334b-ec4f-490e-aa72-362440540ff0 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a1b3ccd4-767c-403e-8f66-30f287be497b" status: 200 len: 351 microversion: 2.1 time: 0.130493 Aug 11 09:59:57.190141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 22/42] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 09:59:57 2022] GET /compute/v2.1/os-volumes/a1b3ccd4-767c-403e-8f66-30f287be497b => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 09:59:57.644998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:57.646329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:57.659530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.661373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.662103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:57.667197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.667197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.667197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:57.729897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:57.731097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:57.779788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.780678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.783932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:57.793295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.794102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.799764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:57.929475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:57.940850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-53f011e4-6d48-4cd3-8765-4db43d3ac478 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1270 microversion: 2.1 time: 0.300797 Aug 11 09:59:57.960985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 21/43] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:57 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:57.968071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:57.968884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:57.988909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.993420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.993420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:57.993420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:57.993420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:57.993697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:58.069030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:58.107033 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3773d5ae-6cc6-4d0d-a683-4c08f303dfed tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1279 microversion: 2.1 time: 0.383049 Aug 11 09:59:58.114095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:57 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1279 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 09:59:58.162621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:58.164958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:58.175910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:58.209851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e33b6c5c-5512-43ea-828e-4e8ab75e021f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1289 microversion: 2.1 time: 0.245517 Aug 11 09:59:58.211787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:58.214209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 22/45] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:57 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1289 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:58.214440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:58.214899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:58.215643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:58.216112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:58.216541 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:58.597273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:58.631651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3144fff5-a39a-4ea6-8ea3-6c08169137dd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1300 microversion: 2.1 time: 0.510826 Aug 11 09:59:58.634170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 24/46] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:58 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1300 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:58.963886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:58.969789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:59.000778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.006380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.006861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.007796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.008178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.008606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.142164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:59.142837 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:59.167246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.172356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.175222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.179607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.181956 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.184573 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.386292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:59.399240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3cf1017d-9e2a-4500-8742-3636eca4c929 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1279 microversion: 2.1 time: 0.260995 Aug 11 09:59:59.400403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 25/47] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:59 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:59.418203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:59.418203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:59.424212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.424795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.425175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.429279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.429916 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.434361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.896742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 09:59:59.905321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-94a1d84b-9aef-48db-8f12-31b697994571 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1295 microversion: 2.1 time: 0.503588 Aug 11 09:59:59.905904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:59 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1295 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 09:59:59.917063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 09:59:59.919187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 09:59:59.942108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.942935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.943520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 09:59:59.944407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 09:59:59.945124 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 09:59:59.945744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:00.103318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:00.116717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-96e9dadc-2332-44f0-80eb-80c80f17b5da tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 1.157810 Aug 11 10:00:00.119633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 23/49] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:58 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:00.139128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:00.152077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2030749f-03d3-4cc3-9355-baa1c2c8ef8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1300 microversion: 2.1 time: 0.240367 Aug 11 10:00:00.153300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 27/50] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 09:59:59 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:00.170060 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cec1ecc9-9609-4a85-a017-5768be243c4e tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c645670>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:00.332013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cec1ecc9-9609-4a85-a017-5768be243c4e tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25785a96-bc4d-4c97-bd20-38e4ea37742a" status: 200 len: 350 microversion: 2.1 time: 0.193650 Aug 11 10:00:00.333056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:00:00 2022] GET /compute/v2.1/os-volumes/25785a96-bc4d-4c97-bd20-38e4ea37742a => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:00.419917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:00.420520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:00.433900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:00.434418 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:00.434856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:00.441828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:00.443228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:00.443674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:00.929379 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:00.932903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:00.955385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:00.955812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:00.956440 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:00.962657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.006661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:01.006932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-135a376e-c0a4-4174-ab31-f5d70abf4b95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1279 microversion: 2.1 time: 0.548556 Aug 11 10:00:01.007578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:01.007653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 28/52] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:00 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1279 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:01.007732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.146047 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:01.146047 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:01.152506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:01.153175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:01.153452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.154152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:01.154659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:01.155098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.720982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:01.741185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0dd91453-6222-4289-9bd8-bd947873ebf1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.815855 Aug 11 10:00:01.741769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 25/53] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:00 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:01.751974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:01.758137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:01.772695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:01.773488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:01.774098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.774975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:01.775593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:01.776026 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:01.836877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:01.850581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-616c32e4-85fe-447f-9d05-b009e467cb7e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.709949 Aug 11 10:00:01.852098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 29/54] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:01 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:02.026703 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:02.027314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:02.036321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.043678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.044125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.045746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.046360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.047377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.081959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:02.096468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fc8ace04-3b2b-460b-9673-5f89f375b367 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.349354 Aug 11 10:00:02.097085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 26/55] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:01 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:02.270537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:02.272580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ab1218-d009-4e11-8813-b820e969974f", "tag": "95a7c9a1-661d-4fc5-a036-2782d7ba88c6"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:02.278475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-84d25e92-8a49-436f-a60b-41a7f0794cdd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.256418 Aug 11 10:00:02.280106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 30/56] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:02 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:02.285448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.285915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.286362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.305206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Creating event network-changed:95a7c9a1-661d-4fc5-a036-2782d7ba88c6 for instance 17ab1218-d009-4e11-8813-b820e969974f on hv-cinder-81566 Aug 11 10:00:02.305716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 10:00:02.306095 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b7ee5491-ecc6-4c48-a560-82659addb5ac req-e9a52798-6453-47c2-b2e5-d02a268f5427 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 10:00:02.307072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.307547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.307969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.308663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.309133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.309548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.317972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.compute.rpcapi [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 10:00:02.321095 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] Releasing lock "compute-rpcapi-router" {{(pid=121197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 10:00:02.334781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a374e35-9379-4a30-b58e-ba4e5cdfd094 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157344 Aug 11 10:00:02.336418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 27/57] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:02.512719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a425ac59-2ce8-4145-af01-95da3c5e4ecd", "tag": "9c73167f-f18a-402d-9396-35d6a751c9f6"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:02.525695 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.526164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.526586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.546040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Creating event network-changed:9c73167f-f18a-402d-9396-35d6a751c9f6 for instance a425ac59-2ce8-4145-af01-95da3c5e4ecd on hv-cinder-81566 Aug 11 10:00:02.546562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 10:00:02.546944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-e7515937-6e8c-4674-9560-d81ef7ad6134 req-355ce728-2bf0-40ae-b820-c791c0bd20f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 10:00:02.548099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.548493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.548948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.549685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.555170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.555170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.558834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.compute.rpcapi [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 10:00:02.559695 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] Releasing lock "compute-rpcapi-router" {{(pid=121196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 10:00:02.574253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-da6dab2a-232a-40d2-b950-3f472464d060 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122274 Aug 11 10:00:02.574837 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 31/58] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:02.762651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:02.763370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:02.770248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.770721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.771149 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.771833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.772281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.772699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.872113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:02.872803 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:02.879539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.880051 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.880480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.881213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:02.881691 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:02.882090 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:02.902861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:02.911684 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-559357fb-c95e-4095-b9b6-1c19b2638927 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.153272 Aug 11 10:00:02.912358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 28/59] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:02 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:03.016935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:03.024587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-dbf3e85b-630d-49e7-8a78-ac46955d4668 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.156686 Aug 11 10:00:03.025213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 32/60] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:02 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:03.119700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:03.120363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:03.127216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.127688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.128143 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:03.128813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.129281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.129908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:03.261821 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:03.273323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0fb0ee7c-137d-4d22-8d18-68591cfab889 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.157345 Aug 11 10:00:03.274050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 29/61] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:03 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:03.300464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:03.301139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:03.307383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.307989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.308289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:03.308971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.309450 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.309868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:03.444496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:03.452165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7253eb5b-a6b9-42b1-b098-8a7f0849fa0d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.156190 Aug 11 10:00:03.454648 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 33/62] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:03 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:03.932968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:03.933702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:03.935648 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:03.940622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.941174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.941729 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:03.942528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:03.942984 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:03.943408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.046630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:04.047792 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:04.063316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.063810 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.064254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.064963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.065478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.065905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.091063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:04.101089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-91e7f152-87f9-4e90-9e91-0144552d04c6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.171875 Aug 11 10:00:04.102096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 30/63] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:03 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:04.223479 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:04.227005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:04.231740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f391d83f-b8b8-4077-9e98-5797fe880025 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.188968 Aug 11 10:00:04.239404 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:04 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:04.294883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:04.295750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:04.303852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.304716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.305451 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.306320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.307005 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.307596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.458496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:04.466495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9a43ae79-f97f-4c2f-80cb-8538f09e2af4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.175544 Aug 11 10:00:04.467064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:04 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:04.473508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:04.474154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:04.477587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:04.481036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.481511 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.481938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.482606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:04.483050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:04.483463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:04.647385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:04.661475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-76162088-4314-4a29-bd30-e2790e0da482 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.191051 Aug 11 10:00:04.673052 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:04 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:05.121133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:05.121742 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:05.128623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.129406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.130009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.130922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.131584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.132014 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.262905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:05.266272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:05.272415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.272826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.273211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.274363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.274829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.275257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.346027 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:05.357666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1351be98-a54e-4db3-9228-f93f53d6a788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.240363 Aug 11 10:00:05.359833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 32/67] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:05 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:05.373977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=26 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:05.488799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:05.489545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:05.491634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=24 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:05.493199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:05.501383 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.501764 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.502267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.503082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.503535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.503945 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.505094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f888985c-437d-4f1a-bea2-555f8c08baa9 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.245891 Aug 11 10:00:05.505781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 36/68] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:05 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:05.679164 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:05.683657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:05.684290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:05.686681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd8d36bf-ab1f-47af-9a99-479ba4808ae4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.202879 Aug 11 10:00:05.687952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 33/69] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:05 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:05.691032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.691514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.691946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.692634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:05.693115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:05.693536 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:05.836882 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:05.846086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cb8037b8-3a28-4350-84e0-acf3cfe2b369 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.166108 Aug 11 10:00:05.847009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 37/70] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:05 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:06.384152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:06.384763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:06.391193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.391876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.392465 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.393358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.394098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.394743 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.399501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:06.532069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:06.533201 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:06.540111 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.540711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.541277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.542148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.542707 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.543255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.568360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:06.576985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-21b343c4-119d-4495-a192-19d9e745b998 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.200070 Aug 11 10:00:06.577786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 34/71] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:06 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:06.699591 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:06.708189 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2673183c-ab32-4f19-818e-4b382795d07b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.184164 Aug 11 10:00:06.708608 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:06.709546 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 38/72] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:06 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:06.713467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:06.722425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.725300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.725300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.725300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.725300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.725625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.882407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:06.882407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:06.882407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.882752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:06.882864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.882864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.882864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:06.882864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:06.883194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:06.886265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-52445606-b1d1-4a5a-8e61-28fc367bdb00 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.181566 Aug 11 10:00:06.886978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 35/73] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:06 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:07.044468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:07.052603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ad84a974-4ab2-4caf-a479-efe136efdef0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.187719 Aug 11 10:00:07.053199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:06 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:07.599893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:07.600477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:07.615321 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.616104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.616696 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.617579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.618166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.618732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.732999 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:07.734254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:07.740792 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.741575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.742552 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.743465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.744024 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.744559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.841294 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:07.852875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bd3a7e47-6757-4f13-8267-8dd47787dc92 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.256741 Aug 11 10:00:07.853602 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 36/75] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:07 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:07.910673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:07.910673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:07.918661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.919925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.920359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.921409 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:07.923497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:07.926033 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:07.961307 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:07.970546 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8cc0091a-e7cf-4a88-ba1f-06381bb1a343 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.241882 Aug 11 10:00:07.975707 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 40/76] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:07 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:08.073594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.074380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:08.083432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:08.084209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:08.085080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:08.086029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:08.093837 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:08.093837 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:08.110881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:08.121719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-afa1304f-04cb-404e-9773-cf7adc77e38f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.218994 Aug 11 10:00:08.126581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 37/77] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:07 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:08.135580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-601e58d4-b895-4358-b377-a388656d5cbe tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c6273a0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.204851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-601e58d4-b895-4358-b377-a388656d5cbe tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ea417a3c-fbb8-46f7-8d39-e6800fc070cb" status: 200 len: 350 microversion: 2.1 time: 0.076970 Aug 11 10:00:08.213697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 38/78] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes/ea417a3c-fbb8-46f7-8d39-e6800fc070cb => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:08.218447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f4bdd23-3de3-4887-a065-dba9c8dc3b29 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c627af0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.314983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:08.328616 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8b3e5ee3-4e92-468e-b614-f8660fd6163e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.258853 Aug 11 10:00:08.333479 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 41/79] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:08.366028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0f4bdd23-3de3-4887-a065-dba9c8dc3b29 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.147758 Aug 11 10:00:08.366028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 39/80] 10.222.0.17 () {58 vars in 1134 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:08.379019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5e7892a1-4009-4110-b77f-a10fde0e100b tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787cdb0940>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.470436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5e7892a1-4009-4110-b77f-a10fde0e100b tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096589 Aug 11 10:00:08.471007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 42/81] 10.222.0.17 () {58 vars in 1149 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:08.485570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd68272b-c86b-432d-9044-6e4490f9f71e tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c5bc8b0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.576791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd68272b-c86b-432d-9044-6e4490f9f71e tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095738 Aug 11 10:00:08.577394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 40/82] 10.222.0.17 () {58 vars in 1134 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:08.591650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8cb29d9f-1c4b-4ae2-874c-8004a050b6b8 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787cdfdc10>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.679985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8cb29d9f-1c4b-4ae2-874c-8004a050b6b8 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092649 Aug 11 10:00:08.680554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 43/83] 10.222.0.17 () {58 vars in 1167 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:00:08.694433 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4f0eb7ad-45e5-4cea-ae98-24a8cefb3a47 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c645310>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.841097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4f0eb7ad-45e5-4cea-ae98-24a8cefb3a47 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.150380 Aug 11 10:00:08.841950 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 41/84] 10.222.0.17 () {58 vars in 1170 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:08.855803 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-aa2a3071-e658-400b-bb4b-874b513be1a1 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787cde1040>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.876598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:08.877235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:08.883235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:08.883864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:08.884341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:08.885053 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:08.885554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:08.885975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.000509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-aa2a3071-e658-400b-bb4b-874b513be1a1 tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.148205 Aug 11 10:00:09.009403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 44/85] 10.222.0.17 () {58 vars in 1155 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:09.015720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:09.017223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:09.026384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.027435 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.028091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.029066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.030624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.032028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.206187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:09.219175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f9dbe1e1-0976-4544-bfce-f4b9e3ab47dc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.347268 Aug 11 10:00:09.219663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 42/86] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:08 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:09.244098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-32f31fb4-8803-408f-83eb-83bb6f2594fd tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787c627b80>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:09.273263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:09.280472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a30d8a50-3083-4bfb-8f65-f345f1f21269 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.269420 Aug 11 10:00:09.282295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 45/87] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:09 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:09.286566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:09.287166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:09.293480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.293910 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.294340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.295085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.295534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.295951 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.411784 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-32f31fb4-8803-408f-83eb-83bb6f2594fd tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187658 Aug 11 10:00:09.411784 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 43/88] 10.222.0.17 () {58 vars in 1188 bytes} [Thu Aug 11 10:00:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:09.414956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:09.415919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:09.424444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.425381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.426279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.427233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:09.444009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:09.444636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:09.484643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:09.499255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-25334194-01a6-4f6a-9a28-5c36c6932aa3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.216341 Aug 11 10:00:09.500709 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 46/89] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:09 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:09.518263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b1065826-8982-4d2b-884f-6653b83d094a tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] Calling method '.version_select at 0x7f787cdf0790>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:09.661963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:09.675613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bab455ff-0ba7-4b0e-b586-30e63fb33cf9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.265177 Aug 11 10:00:09.676798 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 44/90] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:09 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:09.684530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b1065826-8982-4d2b-884f-6653b83d094a tempest-VolumesTestJSON-715915602 tempest-VolumesTestJSON-715915602-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.182591 Aug 11 10:00:09.688428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 47/91] 10.222.0.17 () {58 vars in 1155 bytes} [Thu Aug 11 10:00:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:10.242390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:10.243781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:10.252672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.264601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.264601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.264601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.264601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.266002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.305949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:10.306637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:10.313977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.322251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.322251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.322251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.322251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.322611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.477883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:10.492324 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3794ca07-d948-4a3f-9263-e8aacdf3ab61 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.251531 Aug 11 10:00:10.492936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 45/92] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:10 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:10.524389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:10.525301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:10.531457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.532125 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.533711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.534437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.534888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.535307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.694542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:10.705767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-190a2873-21b1-46b3-b3bb-c32077ae66c8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.407226 Aug 11 10:00:10.707171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 48/93] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:10 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:10.713600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:10.719261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:10.721464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.722130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.722563 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:10.723264 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:10.723718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:10.724190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:11.389539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:11.395183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b5445b30-33c2-4b6e-b728-32d0add2dedd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.874660 Aug 11 10:00:11.409061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 46/94] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:10 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:11.514675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:11.518166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:11.526610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:11.527156 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:11.528090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:11.528801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:11.529279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:11.529706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:11.651735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:11.660520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f74fe4c4-27c8-45b0-8193-12f4d00107d3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.952097 Aug 11 10:00:11.661118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 49/95] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:10 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:11.727345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:11.727948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:11.735571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:11.735770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:11.736434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:11.739220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:11.739857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:11.740553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:12.050235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:12.060453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8d33a917-398a-46af-95c7-cba6fb9d84d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.550508 Aug 11 10:00:12.073343 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 47/96] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:11 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:12.095360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e982719f-0cc3-44b1-aebb-f7832a9e7440", "tag": "576ef535-ab3b-48c0-8bed-8b51e76c62c5"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:12.109104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:12.109850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:12.110504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:12.124378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] Creating event network-changed:576ef535-ab3b-48c0-8bed-8b51e76c62c5 for instance e982719f-0cc3-44b1-aebb-f7832a9e7440 on hv-cinder-81566 Aug 11 10:00:12.131944 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-7f8516c0-28de-4fff-a728-c5cf70fbd6d8 req-a2913333-b888-43be-8684-e8f297772932 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054248 Aug 11 10:00:12.132552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 48/97] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:12.263924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:12.275126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8262415b-087d-46b9-aed8-ad88cf79222f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.551574 Aug 11 10:00:12.276029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 50/98] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:11 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:12.420242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:12.422752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:12.437767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=6 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:12.441603 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:12.444314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:12.444314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:12.444960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:12.445427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:12.445972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:12.689226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:12.690836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:12.694795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=8 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:12.701481 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:12.707732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:12.707732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:12.707732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:12.707732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:12.708165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.033628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:13.041234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a876a726-9596-4be8-a238-e19014611192 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.627492 Aug 11 10:00:13.042018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 49/99] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:12 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:13.084231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:13.087914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:13.094840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:13.094840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:13.094840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.094840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:13.097427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:13.097912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.126588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:13.134868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-21708689-1d24-4f25-b344-b7a86c9ba882 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.456352 Aug 11 10:00:13.135848 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 51/100] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:12 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:13.220719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfb9f02-1255-481b-b2df-bd1b4b8f9159", "tag": "9cf7816f-b470-4208-8712-e05aa700d205"}, {"name": "network-changed", "server_uuid": "646b1a35-413b-40a1-84d4-2534bee9e260", "tag": "ec699f8d-e564-4579-b1ab-b720accb3d1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:13.232346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:13.232923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:13.233441 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.246815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Creating event network-changed:9cf7816f-b470-4208-8712-e05aa700d205 for instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 on hv-cinder-81566 Aug 11 10:00:13.247386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] Creating event network-changed:ec699f8d-e564-4579-b1ab-b720accb3d1c for instance 646b1a35-413b-40a1-84d4-2534bee9e260 on hv-cinder-81566 Aug 11 10:00:13.254952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-f9bf55c9-ede1-4c4a-9156-cf747a9ff736 req-028e9e73-6d67-4af8-8eef-03eba99ee762 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037929 Aug 11 10:00:13.255865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 52/101] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:00:13.296862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:13.297744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:13.304563 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:13.305295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:13.305734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.306423 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:13.306876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:13.307338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:13.367760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:13.376598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd1dc004-94c3-4d89-9acc-693d2c37436d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.296318 Aug 11 10:00:13.380749 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 50/102] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:13 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:13.500847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:13.504050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6bca7ef7-7399-47e3-8cf8-912066aabeb8 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.211861 Aug 11 10:00:13.504623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 53/103] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:13 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:14.062461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:14.063269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:14.069230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.069722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.070337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.071040 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.071494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.072231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.157149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:14.157751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:14.163631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.164108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.164552 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.165245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.165694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.166110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.223656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:14.231322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-137793a3-5cd0-4722-8ee3-81a5a866a922 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.173127 Aug 11 10:00:14.231901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 51/104] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:14 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:14.321631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:14.329745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8bed9d7d-e813-4917-b385-8a85e6fcfb88 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.176400 Aug 11 10:00:14.330587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 54/105] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:14 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:14.399435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:14.402873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:14.408794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.409299 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.409733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.410645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.411458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.411891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.525539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:14.533223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:14.540259 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.540997 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.542001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.543238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:14.544179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:14.544847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:14.566761 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:14.575312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-647abd25-5492-461d-be7f-483546786912 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.180626 Aug 11 10:00:14.576131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 52/106] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:14 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:14.792127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:14.801229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bf1adee0-f23d-4404-bffb-c522842a44d0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.279754 Aug 11 10:00:14.802212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 55/107] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:14 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:15.253420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:15.254083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:15.261089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.261580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.262012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.262701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.263152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.263732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.351664 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:15.352470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:15.358425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.359615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.360192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.360981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.361452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.361873 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.372534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:15.423128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:15.435112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-683262a5-3d41-4000-bc47-2ebd23851f1e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.185041 Aug 11 10:00:15.449122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 53/108] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:15 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:15.533459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:15.560058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f81f75ae-1dcb-48c4-b42e-bc09561e1bc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.212379 Aug 11 10:00:15.560639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 56/109] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:15 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:15.602411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:15.603257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:15.611342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.612136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.612770 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.613675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.614329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.616840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.822116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:15.822721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:15.830270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.834366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.834366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:15.834366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:15.834366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:15.834799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:16.242634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:16.248594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:16.252781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7a4ba385-ed44-4b60-ba71-2d3c13d2b59f tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.434313 Aug 11 10:00:16.256259 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:15 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:16.270935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c3b2c89a-cef4-44a2-ad81-b0196fcc4357 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.673367 Aug 11 10:00:16.272409 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:15 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:16.460120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:16.461493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:16.471016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:16.472989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:16.479919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:16.482284 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:16.492361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:16.492361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:16.584312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:16.584943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:16.596353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:16.598662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:16.599088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:16.599794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:16.615236 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:16.617367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:16.790559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:16.798995 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8562d9b4-9d74-4248-bc2e-79203f5438b8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.343267 Aug 11 10:00:16.813607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 58/112] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:16 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:16.854254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:16.866250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-01b84881-754b-4542-b2b0-932b27a64b8e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.287248 Aug 11 10:00:16.866823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 55/113] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:16 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:17.273767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:17.274719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:17.284238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.285338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.286098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.287005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.287823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.288432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.295000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:17.296659 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:17.307864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.308586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.310391 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.311201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.314663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.317332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.358088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:17.575508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:17.586617 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:17.592742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-60ee5f32-221d-44dc-890a-68951c5aeedb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.322855 Aug 11 10:00:17.595140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 59/114] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:17 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:17.596545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-55b5db5a-1d7a-4fab-9673-2403e349b93c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.306023 Aug 11 10:00:17.597158 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 56/115] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:17 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:17.829831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:17.830614 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:17.840639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.841394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.844163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.845218 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.846070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.846323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.889200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:17.890049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:17.897492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.898280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.899654 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:17.900626 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:17.901455 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:17.902318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:18.247685 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:18.258783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8cf375ff-c75d-43d5-b3a6-f84fc753648f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.374712 Aug 11 10:00:18.261336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 57/116] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:17 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:18.275158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:18.281912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7fdbcb6d-4eee-4ca5-86a8-ede08338d502 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.462152 Aug 11 10:00:18.282568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 60/117] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:17 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:18.387093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ab1218-d009-4e11-8813-b820e969974f", "name": "network-vif-plugged", "status": "completed", "tag": "95a7c9a1-661d-4fc5-a036-2782d7ba88c6"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:18.411250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:18.411730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:18.412154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:18.426562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] Creating event network-vif-plugged:95a7c9a1-661d-4fc5-a036-2782d7ba88c6 for instance 17ab1218-d009-4e11-8813-b820e969974f on hv-cinder-81566 Aug 11 10:00:18.433464 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-44dbf926-24f1-49ec-a7af-b739b39a754f req-484c13c8-bfc8-40aa-adca-57b8c5c49f91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132996 Aug 11 10:00:18.434287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 58/118] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:18.617523 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:18.618151 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:18.618271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:18.618933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:18.651926 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:18.654637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:18.657168 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:18.657631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:18.658371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:18.658833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:18.659265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:18.661584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:18.662137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:18.665924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:18.674859 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:18.675692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:19.203573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:19.215351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ea3b87ba-6ab7-45a2-8c73-421313eb561d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.602026 Aug 11 10:00:19.217314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 59/119] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:18 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:19.241165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:19.258013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a1f87424-2fd2-416d-b893-9e4988b99a20 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.639699 Aug 11 10:00:19.258013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:18 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:19.283474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:19.285154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:19.290992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:19.291683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:19.292413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:19.293293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:19.294024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:19.294633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:19.306965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:19.307910 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:19.318242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:19.318242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:19.318242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:19.318743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:19.319327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:19.320068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:19.578322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:19.587743 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c13927a1-8273-4e49-946c-7b4be14bb589 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.307920 Aug 11 10:00:19.588332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 60/121] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:19 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:19.599241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:19.607435 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a0d338a5-b3e6-4f0a-848e-2a1b16c835f6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.304599 Aug 11 10:00:19.609349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 62/122] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:19 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:20.240924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:20.241689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:20.247819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.248617 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.249849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.250645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.251303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.251878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.277125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:20.278305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:20.300591 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.300696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.301105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.301983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.302585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.303177 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.490344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:20.498651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6d2215db-1c5f-40d2-89f5-bdd4f6afe278 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.262433 Aug 11 10:00:20.499970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:20 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:20.537824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:20.557342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ccacc4f7-6853-4cbf-8080-aea14b1481dc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.281794 Aug 11 10:00:20.562563 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 63/124] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:20 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:20.609180 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:20.609965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:20.616434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.616922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.617641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.619091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.619091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.619528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.630476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:20.631094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:20.637044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.637556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.638021 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.638874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.639483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.639936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.871404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:20.880291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5b196e29-5e95-4e63-9d2a-5cc83bca59c0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.275666 Aug 11 10:00:20.890931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 62/125] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:20 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:20.891398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:20.899620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e982719f-0cc3-44b1-aebb-f7832a9e7440", "name": "network-vif-plugged", "status": "completed", "tag": "576ef535-ab3b-48c0-8bed-8b51e76c62c5"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:20.905786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6a06b667-bb6e-4bb4-9f18-a92cf42ee9ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.275474 Aug 11 10:00:20.906716 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 64/126] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:20 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:20.927214 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:20.927697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:20.928418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:20.943397 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] Creating event network-vif-plugged:576ef535-ab3b-48c0-8bed-8b51e76c62c5 for instance e982719f-0cc3-44b1-aebb-f7832a9e7440 on hv-cinder-81566 Aug 11 10:00:20.949139 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-5007c3f0-442f-4a35-bdde-b2282f0691a6 req-35254284-ecfd-4286-91f7-99f686c8be5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067009 Aug 11 10:00:20.956206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 63/127] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:21.520141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:21.521502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:21.527876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.529131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.529779 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.531045 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.531483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.532144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.591082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:21.591082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:21.591082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.591082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.591989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.593952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.594625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.595204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.833517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:21.869796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6d70dcda-7d5c-46c0-ae0a-7b0f92484b62 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.330635 Aug 11 10:00:21.869796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 65/128] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:21 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:21.882679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:21.903062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:21.931083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:21.931376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-334b9ba0-04e2-4acd-a950-524e628fff27 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.328142 Aug 11 10:00:21.931376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 64/129] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:21 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:21.931559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.931559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.931559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.931559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.931893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.931893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.932037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:21.932037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:21.950422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.950994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.951797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:21.952649 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:21.953279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:21.953823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:22.181200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:22.181200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9e300388-f23a-406e-922f-de4160d23dfd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.265577 Aug 11 10:00:22.181200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 66/130] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:21 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:22.188056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:22.198838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ce7a5db8-a733-49c5-a7e8-2635e177feb3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.274853 Aug 11 10:00:22.200055 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 65/131] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:21 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:22.867985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:22.869301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:22.875901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:22.876387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:22.876812 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:22.877534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:22.877981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:22.878480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:22.950883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:22.951444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:22.965300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:22.965300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:22.965300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:22.965300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:22.965586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:22.965586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.032384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:23.041357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b74f2b01-9673-44de-8c31-166d924e93f4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1363 microversion: 2.1 time: 0.177313 Aug 11 10:00:23.041933 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 67/132] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:22 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:23.085258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a425ac59-2ce8-4145-af01-95da3c5e4ecd", "name": "network-vif-plugged", "status": "completed", "tag": "9c73167f-f18a-402d-9396-35d6a751c9f6"}, {"server_uuid": "646b1a35-413b-40a1-84d4-2534bee9e260", "name": "network-vif-plugged", "status": "completed", "tag": "ec699f8d-e564-4579-b1ab-b720accb3d1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:23.112374 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:23.112895 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:23.115287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.132355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Creating event network-vif-plugged:9c73167f-f18a-402d-9396-35d6a751c9f6 for instance a425ac59-2ce8-4145-af01-95da3c5e4ecd on hv-cinder-81566 Aug 11 10:00:23.132875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] Creating event network-vif-plugged:ec699f8d-e564-4579-b1ab-b720accb3d1c for instance 646b1a35-413b-40a1-84d4-2534bee9e260 on hv-cinder-81566 Aug 11 10:00:23.140267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-fd55327b-1684-4c81-ba40-126fcfde605d req-a0d759a0-9564-498f-a50f-943a489f2c16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082655 Aug 11 10:00:23.141128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 68/133] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:23.167809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:23.176894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ff32ac04-0e4a-4baf-8b52-03768c84e33c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.230407 Aug 11 10:00:23.177596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 66/134] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:22 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:23.193444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:23.194424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:23.203070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:23.203594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:23.204190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.205067 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:23.205533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:23.205955 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.220661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:23.221808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:23.227935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:23.228809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:23.229349 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.230088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:23.230701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:23.231146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:23.415159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:23.418662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:23.424096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-865140d1-2bca-4a01-8a4b-7f9af080fdcb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.241599 Aug 11 10:00:23.424909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 69/135] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:23 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:23.429606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2779a50c-96ff-4adf-902a-a4f38a880221 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.213150 Aug 11 10:00:23.441037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 67/136] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:23 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:24.063506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:24.064115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:24.070468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.070954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.071447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.072141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.072594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.073252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.198338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:24.199462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:24.208943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.209640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.211887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.211887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.211887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.211887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.268263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:24.276374 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d078afaf-4f40-4d7e-9f8f-d0634b0e5faf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1549 microversion: 2.1 time: 0.217475 Aug 11 10:00:24.276934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 70/137] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:24 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:24.301373 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:24.301898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:24.308004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.308498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.308982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.309931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.310386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.310855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.415446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:24.424125 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5f8a2c88-2d40-4f89-8d8b-6f1c942e9a1b tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.229519 Aug 11 10:00:24.424754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 68/138] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:24 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:24.445075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:24.445809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:24.453028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.453673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.454119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.454817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.455282 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.455759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.470028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-04911556-f063-4bad-b7db-1e3b4fb8393d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166184 Aug 11 10:00:24.470028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 71/139] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:00:24 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:00:24.470028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:24.470028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:24.474679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.475358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.476638 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:24.477113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:24.477675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:24.672585 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:24.682286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f5c276ee-aef6-44df-84b4-88830eb7e107 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.240111 Aug 11 10:00:24.683277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 69/140] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:24 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:24.767494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:24.779816 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-66435b21-4c73-4624-93bc-d073c42c36d7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.312165 Aug 11 10:00:24.779816 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 72/141] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:24 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:25.157480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfb9f02-1255-481b-b2df-bd1b4b8f9159", "name": "network-vif-plugged", "status": "completed", "tag": "9cf7816f-b470-4208-8712-e05aa700d205"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:25.166837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.167304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.167720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.179692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] Creating event network-vif-plugged:9cf7816f-b470-4208-8712-e05aa700d205 for instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 on hv-cinder-81566 Aug 11 10:00:25.184706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-dd8b74e0-fae4-4302-9fb9-9f359d8c4aca req-743c9bcd-78b7-43b2-a1e7-d289acfa0b9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 Aug 11 10:00:25.185510 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 70/142] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:25.449533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:25.450551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:25.471039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.473661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.473661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.473661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.473661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.474019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.646598 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:25.650113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:25.656095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3c3363bc-db00-4863-84e9-761685f58328 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1312 microversion: 2.1 time: 0.209831 Aug 11 10:00:25.656817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 73/143] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:25 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:25.705406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:25.706103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:25.713512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.714244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.714882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.715586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.716205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.716908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.803580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:25.804312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:25.837265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.838096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.838640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:25.839462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:25.840019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:25.840554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:26.006226 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:26.030990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:26.049487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-58a82e3d-5f72-4d51-bdfc-8718a62b2b30 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.254356 Aug 11 10:00:26.050258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:25 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:26.054992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e982719f-0cc3-44b1-aebb-f7832a9e7440", "tag": "576ef535-ab3b-48c0-8bed-8b51e76c62c5"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:26.065293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:26.065656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2ef367a8-c8a9-4dcf-93f2-e188f2c854b3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1321 microversion: 2.1 time: 0.365206 Aug 11 10:00:26.065745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:26.066153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 71/145] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:25 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:26.066287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:26.084818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] Creating event network-changed:576ef535-ab3b-48c0-8bed-8b51e76c62c5 for instance e982719f-0cc3-44b1-aebb-f7832a9e7440 on hv-cinder-81566 Aug 11 10:00:26.090916 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-ffd6b0f5-a412-4d9c-8ed5-faeb5aea2cd5 req-d6b0deba-b037-4588-912e-b4d373f6af35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039131 Aug 11 10:00:26.091469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 75/146] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:26.676968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:26.677597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:26.683529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:26.684152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:26.684682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:26.685327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:26.685786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:26.686814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:26.834645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:26.843883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-37f010b6-a766-4bf6-9ba6-29b57cd38796 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1498 microversion: 2.1 time: 0.170702 Aug 11 10:00:26.847489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 72/147] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:26 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:27.072181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:27.081326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:27.086822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:27.087429 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:27.093663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.094256 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.094724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.095029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.095206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.095656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.096205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.096346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.096802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.097126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.097235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.097778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.522709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:27.534736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:27.537777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9652b43a-7830-4457-bddf-227b401fd83c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1516 microversion: 2.1 time: 0.454688 Aug 11 10:00:27.538961 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:27 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1516 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:27.550730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ea15aaa7-d22b-4849-ae85-4af58cc783a2 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.482968 Aug 11 10:00:27.551883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 76/149] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:27 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:27.560556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:27.566208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:27.570025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.570513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.570937 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.571813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:27.572266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:27.572681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:27.636970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'flavor' on Instance uuid 646b1a35-413b-40a1-84d4-2534bee9e260 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:00:27.703249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:28.061689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3d4fc6bc-c7ba-4100-9150-5f70a7931836 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260/action" status: 200 len: 32 microversion: 2.1 time: 0.505307 Aug 11 10:00:28.062375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 74/150] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:00:27 2022] POST /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:00:28.071741 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:28.078149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:28.095363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.095840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.096271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:28.096975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.097451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.099209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:28.446538 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:28.455796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f1bc6b38-f4f1-436e-8041-5c49377ee2b0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.387865 Aug 11 10:00:28.458178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 77/151] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:28 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:28.580799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:28.581539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:28.588337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.588826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.589335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:28.589969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.590455 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.597583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:28.743548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:28.752231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-84ac7752-cddf-4e48-a25f-2b0eae7d0873 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1368 microversion: 2.1 time: 0.176821 Aug 11 10:00:28.752813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 75/152] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:28 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:28.835263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28b5f52f-921e-4aab-bf1c-3e085963d03c"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:28.837952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:28.844254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.844736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.845217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:28.845904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:28.846357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:28.846778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.488472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:29.488954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:29.494910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.495383 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.495804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.496474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.496915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.497362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.641228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:29.659309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-24e95f6e-a86f-4b01-98f5-4ee3b7c7b428 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.174811 Aug 11 10:00:29.659879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:29 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:29.773508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:29.774133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:29.780694 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.781210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.781699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.782407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.782852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.783268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.919278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:29.927391 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4a7834c9-ed16-48e1-b63e-65c559bbd8b5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1558 microversion: 2.1 time: 0.157707 Aug 11 10:00:29.927985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 77/154] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:29 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:29.948132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:29.948607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:29.954633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.955112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.955564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:29.956239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:29.956686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:29.957130 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:30.040021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-19024796-aa33-4b95-99af-987f39b25cd9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095559 Aug 11 10:00:30.040619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 78/155] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:00:29 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:00:30.679660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:30.681084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:30.688380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:30.688863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:30.689532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:30.690919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:30.691257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:30.691766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:30.840310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:30.848135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e99a3e11-8853-4a27-910d-40cff5ea75e0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.172303 Aug 11 10:00:30.853208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:30 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:31.117777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfb9f02-1255-481b-b2df-bd1b4b8f9159", "tag": "9cf7816f-b470-4208-8712-e05aa700d205"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:31.128778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:31.129959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:31.130644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:31.144484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] Creating event network-changed:9cf7816f-b470-4208-8712-e05aa700d205 for instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 on hv-cinder-81566 Aug 11 10:00:31.150089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-ef3ff5e1-1dcc-4607-9e16-c329ae3688d8 req-44759f4e-c666-4047-9639-5d30183d9899 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036630 Aug 11 10:00:31.150833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 80/157] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:00:31.870550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:31.871250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:31.878416 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:31.878906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:31.879341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:31.880512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:31.882057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:31.882681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:32.032532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:32.040550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fc8c7d2f-b341-4f0b-9156-b1a41d74b62b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.174119 Aug 11 10:00:32.041677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:31 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:33.063218 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:33.063840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:33.069757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:33.070245 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:33.070667 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:33.071720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:33.072176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:33.072604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:33.137564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e54317b8-0422-4f87-88d3-1c3216c57c5e tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "POST /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.305980 Aug 11 10:00:33.138094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 78/159] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:00:28 2022] POST /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd/os-volume_attachments => generated 194 bytes in 4307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:00:33.224939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:33.233669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ea50a10a-c5c6-45f4-82e1-ac56411148c7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.173758 Aug 11 10:00:33.234551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 82/160] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:33 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:34.255977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:34.256781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:34.269640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:34.270230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:34.270766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:34.271575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:34.272104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:34.272603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:34.416032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:34.424305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8a28abcc-1240-4da3-89b5-007e838d697d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.173095 Aug 11 10:00:34.424881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 79/161] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:34 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:35.445684 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:35.446283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:35.448285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=96 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:35.454131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:35.454612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:35.455037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:35.455774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:35.456222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:35.456635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:35.605119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:35.613235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5773091a-1b70-44d2-ab30-c87de1e4dc51 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.171611 Aug 11 10:00:35.613808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 83/162] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:35 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:36.633968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:36.634578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:36.637027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=81 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:36.641989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:36.642465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:36.642894 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:36.643567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:36.644044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:36.644612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:36.780900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:36.788632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-08b710c5-700e-4733-8bba-3243d0490fe7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.158736 Aug 11 10:00:36.789224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 80/163] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:36 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:37.808198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:37.808821 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:37.815800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:37.816710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:37.817151 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:37.817840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:37.818289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:37.818711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:37.959775 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:37.967559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d620ac40-0e48-4d07-81df-959e730904f0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.163129 Aug 11 10:00:37.968111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 84/164] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:37 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:38.988633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:38.993979 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:38.996470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:38.996947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:38.997406 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:38.998087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:38.999386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:38.999813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:39.136560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:39.146956 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-66a6f8bc-364a-4222-a85a-f19c6932d687 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.161855 Aug 11 10:00:39.147539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 81/165] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:38 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:40.171174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:40.171776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:40.177941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:40.178414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:40.178835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:40.179522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:40.179960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:40.180456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:40.316333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:40.323838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2697a1ab-972c-49d9-b521-a2b98561b044 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.156631 Aug 11 10:00:40.324492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 85/166] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:40 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:41.346590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:41.347194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:41.353649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:41.354129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:41.354559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:41.355241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:41.355692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:41.356111 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:41.490410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:41.498867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-62c017a0-3b6c-4a07-8596-4df2eddc0a00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.156061 Aug 11 10:00:41.499508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 82/167] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:41 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:42.520471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:42.521108 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:42.527039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:42.527514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:42.527948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:42.528626 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:42.529110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:42.529561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:42.657948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:42.665283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2c83cf90-365d-4919-8dd9-d22408a9ca89 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.148635 Aug 11 10:00:42.665848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 86/168] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:42 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:43.686787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:43.687388 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:43.693748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:43.694224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:43.694650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:43.695321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:43.695763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:43.696199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:43.824485 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:43.832538 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2cc3432f-ad9b-4b4f-b494-fec263bd7458 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.149707 Aug 11 10:00:43.833119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 83/169] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:43 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:44.853887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:44.855116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:44.860453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:44.860930 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:44.861390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:44.862079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:44.862526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:44.862943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:44.998838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:45.006505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6f6fe686-5d84-485a-abc9-cbb4c86f2ae2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.156447 Aug 11 10:00:45.007069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 87/170] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:44 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:46.027714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:46.028881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:46.035631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:46.036112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:46.036542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:46.037259 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:46.037710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:46.038131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:46.181249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:46.189288 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-78a3c30a-47cc-4ca5-a36d-ab48afaf9bb3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.165356 Aug 11 10:00:46.190026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 84/171] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:46 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:47.210559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:47.211165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:47.217453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:47.217936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:47.218366 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:47.219076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:47.220277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:47.220696 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:47.365266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:47.372762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-51d582f7-b407-4806-bade-d81733275f5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.166123 Aug 11 10:00:47.373365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 88/172] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:47 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:48.394656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:48.395262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:48.401701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:48.402190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:48.402623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:48.403338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:48.403793 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:48.404222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:48.540755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:48.548265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-562c24d2-01cd-4446-8cb7-cf7a1b55f3cc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.158228 Aug 11 10:00:48.548814 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 85/173] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:48 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:49.214900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:49.215539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:49.221832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.222314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.222745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.223423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.223871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.224293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.248981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:00:49.286678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:49.572269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:49.573497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:49.590952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.593714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.594340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.595192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.595654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.596606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.642583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1dd326d9-1fc0-4b01-b751-3e18ce1398f0 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 204 len: 0 microversion: 2.1 time: 0.431404 Aug 11 10:00:49.646064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 89/174] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:00:49 2022] DELETE /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:00:49.655782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:49.657128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:49.665284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.665768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.666199 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.666933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:49.667385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:49.670357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:49.823183 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:49.831254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-60cfedb7-8841-483d-84ff-5ba5337c71af tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.262245 Aug 11 10:00:49.831827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 86/175] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:49 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:49.854560 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:49.863207 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-06c8dc67-d52a-459b-8c82-8bf7be522bdb tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.215531 Aug 11 10:00:49.863771 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 90/176] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:49 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:50.852275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:50.852880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:50.862404 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:50.863156 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:50.863603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:50.867352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:50.867352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:50.867352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:50.885445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:50.886458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:50.895990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:50.895990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:50.896725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:50.897594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:50.898141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:50.898623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:51.066813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:51.074603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-74ca6e14-1e27-464a-b48d-f0394e24a3cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.226584 Aug 11 10:00:51.075468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 87/177] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:50 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:51.090792 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:51.099982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-58a240e1-a584-4100-b77f-07fc1b3b3f40 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.220314 Aug 11 10:00:51.100566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 91/178] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:50 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:52.098144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:52.098981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:52.105483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:52.105983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:52.106419 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:52.107118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:52.107577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:52.108001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:52.122291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:52.123625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:52.131112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:52.131604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:52.132037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:52.132734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:52.133217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:52.133644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:52.309508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:52.317955 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:52.318809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5deee7d0-4e5a-488b-a826-7f48e6827743 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.225273 Aug 11 10:00:52.319395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 88/179] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:52 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:52.328569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b7158f5c-4cc3-4aa1-b1ee-b03abcb237e4 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.210407 Aug 11 10:00:52.329446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 92/180] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:52 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:53.340001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:53.340641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:53.348557 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:53.349326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:53.349763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:53.350465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:53.350921 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:53.351732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:53.352739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:53.353464 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:53.360485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:53.361083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:53.361778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:53.362550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:53.363071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:53.363561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:53.584188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:53.587616 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:53.592202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b85af391-77cc-405c-9781-b1b59da89eb7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.256396 Aug 11 10:00:53.593181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 89/181] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:53 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:53.595665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:53.608047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-373b8f2b-101f-48cf-986d-53e97ab31248 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.259784 Aug 11 10:00:53.608514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 93/182] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:53 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:54.613895 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:54.614655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:54.621840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:54.622312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:54.622947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:54.623650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:54.625687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:54.625687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:54.630911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:54.640177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:54.640177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:54.640177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:54.640177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:54.640508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:54.640991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:54.641654 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:54.847647 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:54.855074 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9eec52df-4138-45a0-8a90-fcf05dc0f5ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.245557 Aug 11 10:00:54.855646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 90/183] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:54 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:54.858713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:54.867202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9d267300-71ef-4739-9c58-7299c30ecbbc tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.240333 Aug 11 10:00:54.867957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 94/184] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:54 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:55.876303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:55.876906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:55.883238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:55.883721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:55.884149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:55.884829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:55.885317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:55.885739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:55.893972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:55.894568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:55.900515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:55.901111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:55.901536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:55.902210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:55.902650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:55.903061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:56.298342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:56.303777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:56.307922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-eb44432b-4e38-44e0-980e-81b5a86e9878 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.435348 Aug 11 10:00:56.308743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 91/185] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:55 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:56.316726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-23de929c-43b9-41b0-823d-f8bdc43f0292 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.426872 Aug 11 10:00:56.317575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 95/186] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:55 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:57.332605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:57.332605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:57.338881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:57.346933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:57.356173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:57.359671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:57.360158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:57.360582 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:57.361575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:57.361772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:57.362401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:57.362825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:57.363517 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:57.363968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:57.364373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:57.380572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:57.591339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:57.600648 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:57.602249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd97d309-e993-472a-8179-71936c75773c tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.267733 Aug 11 10:00:57.609300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6cbb18be-1606-4a14-b654-8ce996b0f959 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.282942 Aug 11 10:00:57.609888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 92/187] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:57 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:57.614572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 96/188] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:57 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:58.624851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:58.624851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:58.630290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:00:58.630874 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:00:58.638843 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:58.639338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:58.639774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:58.640472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:58.640926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:58.642869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:58.646378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:58.646862 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:58.647651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:58.647991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:58.648441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:58.648932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:58.980414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:58.987948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-09f657b3-3bc4-4d86-b463-43c4fa796fc0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.361607 Aug 11 10:00:58.988508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 97/189] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:58 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:00:59.003830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:00:59.012398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-92932d9a-df6b-4949-9dc5-06ccf60f27ee tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1550 microversion: 2.1 time: 0.392571 Aug 11 10:00:59.013081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 93/190] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:00:58 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1550 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:00:59.487423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a425ac59-2ce8-4145-af01-95da3c5e4ecd", "name": "network-vif-deleted", "tag": "9c73167f-f18a-402d-9396-35d6a751c9f6"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:00:59.498873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:00:59.499350 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:00:59.499825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:00:59.514193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] Creating event network-vif-deleted:9c73167f-f18a-402d-9396-35d6a751c9f6 for instance a425ac59-2ce8-4145-af01-95da3c5e4ecd on hv-cinder-81566 Aug 11 10:00:59.520069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-046f86d9-b4dd-47fd-bc41-6336ee5fe684 req-fcc3c690-c0d5-467d-a90e-c065d2bd45de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Aug 11 10:00:59.523337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 98/191] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:00.008453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:00.009181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:00.015441 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:00.015894 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:00.016327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:00.017007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:00.017483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:00.017906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:00.043445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:00.044017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:00.050731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:00.051209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:00.051634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:00.052323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:00.052767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:00.053210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:00.127084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:00.136020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7627a3ae-f14b-41ac-963b-82f390dcbc88 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1343 microversion: 2.1 time: 0.096887 Aug 11 10:01:00.136733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 99/192] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:00 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1343 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:00.174883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:00.183532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-58453583-2f46-433b-aa52-73f341155c00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.178855 Aug 11 10:01:00.184109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 94/193] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:00 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:01.156871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:01.157490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:01.163417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:01.163884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:01.164305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:01.164978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:01.165445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:01.165858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:01.196480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:01.196949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:01.197407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:01.197839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lazy-loading 'fault' on Instance uuid a425ac59-2ce8-4145-af01-95da3c5e4ecd {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:01:01.203594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:01.204199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:01.211174 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:01.211656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:01.212266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:01.213245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:01.213702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:01.214121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:01.244928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:01.254041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f8505755-adab-43c1-98d2-53c0b764bf12 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1348 microversion: 2.1 time: 0.100915 Aug 11 10:01:01.254611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 100/194] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:01 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:01.346547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:01.354071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fe2fd533-58c9-4caa-9549-353106ff3fb0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.154299 Aug 11 10:01:01.354746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 95/195] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:01 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:02.274835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:02.275974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:02.281555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:02.282032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:02.282480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:02.283181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:02.283727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:02.284144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:02.313883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:02.314862 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:02.315316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:02.316069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lazy-loading 'fault' on Instance uuid a425ac59-2ce8-4145-af01-95da3c5e4ecd {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:01:02.366267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:02.374858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:02.375301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e9e39a26-859d-4991-86ce-99921ea75d35 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1348 microversion: 2.1 time: 0.104152 Aug 11 10:01:02.375872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 101/196] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:02 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:02.376307 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:02.383275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:02.383754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:02.384184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:02.385041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:02.385492 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:02.385911 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:02.525050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:02.532465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6e57645a-72a9-4772-8994-6afdc7c1acc2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.161610 Aug 11 10:01:02.533087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 96/197] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:02 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:03.396237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:03.397176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:03.403067 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:03.403541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:03.404101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:03.404783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:03.405256 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:03.405673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:03.438050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:03.438523 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:03.438949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:03.439442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lazy-loading 'fault' on Instance uuid a425ac59-2ce8-4145-af01-95da3c5e4ecd {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:01:03.481777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9353bc130d45a99af9386ff9dd9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6ae51a6843404299c66e97cec51fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:03.489781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f4b17763-5599-4a90-9c3d-24d98c15439d tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 200 len: 1348 microversion: 2.1 time: 0.098077 Aug 11 10:01:03.490334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 102/198] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:03 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:03.552813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:03.553440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:03.559782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:03.560295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:03.560720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:03.561424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:03.561870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:03.562288 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:03.690452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:03.697897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-dbc0ab9a-c621-4bd7-966e-e934ce5d573e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.149030 Aug 11 10:01:03.698455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 97/199] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:03 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:04.511881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:04.513170 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:04.520548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.522845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.522845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.522845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.522845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.523212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.537318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] HTTP exception thrown: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Request method failure captured: Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd HTTP/1.1 Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMTNOmSfb8JI3IzE7iqsorM8zA3WlUJXkm8F0GhK73qhZIkGodmfkJHcFfKcu_Cng_UUMJioIUqXTK589r80zZCkNsTuqFjtYaa_SLmfHpB1d7NmE0kmRF7tSYMZCwErXR-trlC_igs6DEnAIlF7dpb778BNpI6JI_nZye9nYcksVI Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:01:04.541954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: bf9353bc130d45a99af9386ff9dd9a2f Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.543355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'a425ac59-2ce8-4145-af01-95da3c5e4ecd'} Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:01:04.544144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.545563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.546673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Returning 404 to user: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:01:04.546785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5a0e15b9-eebc-4aa7-b403-db27483690f1 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 404 len: 111 microversion: 2.1 time: 0.039488 Aug 11 10:01:04.547346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 103/200] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:04 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:01:04.721322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:04.722426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:04.732427 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.732898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.735696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.736809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.737309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.737732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.870228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:04.872430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:04.878850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.879328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.879755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.880444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:04.880891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:04.881365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:04.896293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] HTTP exception thrown: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.911262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Request method failure captured: Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd/os-volume_attachments HTTP/1.1 Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMTNOmSfb8JI3IzE7iqsorM8zA3WlUJXkm8F0GhK73qhZIkGodmfkJHcFfKcu_Cng_UUMJioIUqXTK589r80zZCkNsTuqFjtYaa_SLmfHpB1d7NmE0kmRF7tSYMZCwErXR-trlC_igs6DEnAIlF7dpb778BNpI6JI_nZye9nYcksVI Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:01:04.911575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: bf9353bc130d45a99af9386ff9dd9a2f Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.912920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'server_id': 'a425ac59-2ce8-4145-af01-95da3c5e4ecd'} Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:01:04.913691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:04.914974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:04.916182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Returning 404 to user: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:01:04.916182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-17b53e65-768a-4699-8217-193ca723f09a tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044937 Aug 11 10:01:04.916182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 104/201] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:01:04 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:01:04.919085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-00926794-71f7-4ec6-8a3b-fc179cb47538 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.202443 Aug 11 10:01:04.919777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 98/202] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:04 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:05.940697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:05.941335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:05.943275 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:05.947914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:05.948387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:05.948818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:05.949515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:05.949957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:05.950370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:06.082495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:06.090285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1741f02e-9957-4648-ac02-c36c10dccf75 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.154131 Aug 11 10:01:06.090857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 105/203] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:05 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:07.112674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:07.113220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:07.115527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=38 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:07.120217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:07.120711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:07.121158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:07.121839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:07.122287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:07.122707 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:07.260033 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:07.267723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5e2556a6-620d-4a28-85e6-971e42e3e370 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.159403 Aug 11 10:01:07.268686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 99/204] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:07 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:08.289339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:08.289999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:08.296609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:08.297126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:08.297648 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:08.298422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:08.298891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:08.299316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:08.428682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:08.432306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:08.436651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-893d3420-4a22-4761-a879-f21b8f09d00e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.151551 Aug 11 10:01:08.437296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 106/205] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:08 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:09.458628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:09.459162 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:09.465753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:09.466234 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:09.466666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:09.467352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:09.468358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:09.468358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:09.609117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:09.617074 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2ba672da-1db6-4230-bcc4-336405aa26fc tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.162715 Aug 11 10:01:09.617569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 100/206] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:09 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:10.490213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:10.490830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:10.497225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.497783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.500347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.500347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.500347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.500347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.513078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] HTTP exception thrown: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Request method failure captured: Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd HTTP/1.1 Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMTNOmSfb8JI3IzE7iqsorM8zA3WlUJXkm8F0GhK73qhZIkGodmfkJHcFfKcu_Cng_UUMJioIUqXTK589r80zZCkNsTuqFjtYaa_SLmfHpB1d7NmE0kmRF7tSYMZCwErXR-trlC_igs6DEnAIlF7dpb778BNpI6JI_nZye9nYcksVI Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:01:10.514589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: bf9353bc130d45a99af9386ff9dd9a2f Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.516004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'a425ac59-2ce8-4145-af01-95da3c5e4ecd'} Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:01:10.516708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.518160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.519898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Returning 404 to user: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:01:10.519898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7208e730-7b35-45eb-95e0-25ea3b9f3d49 tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 404 len: 111 microversion: 2.1 time: 0.031042 Aug 11 10:01:10.519898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 107/207] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:01:10 2022] DELETE /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:01:10.524543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:10.525171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] [instance: a425ac59-2ce8-4145-af01-95da3c5e4ecd] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:10.531518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.531998 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.532422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.533651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.534103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.534519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.547667 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] HTTP exception thrown: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Request method failure captured: Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd HTTP/1.1 Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMTNOmSfb8JI3IzE7iqsorM8zA3WlUJXkm8F0GhK73qhZIkGodmfkJHcFfKcu_Cng_UUMJioIUqXTK589r80zZCkNsTuqFjtYaa_SLmfHpB1d7NmE0kmRF7tSYMZCwErXR-trlC_igs6DEnAIlF7dpb778BNpI6JI_nZye9nYcksVI Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:01:10.552908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9f6ae51a6843404299c66e97cec51fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 9f6ae51a6843404299c66e97cec51fec Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-DeleteServersTestJSON-837152916 Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: bf9353bc130d45a99af9386ff9dd9a2f Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-DeleteServersTestJSON-837152916-project Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.554329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'a425ac59-2ce8-4145-af01-95da3c5e4ecd'} Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:01:10.555125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. Aug 11 10:01:10.556456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:10.557799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] Returning 404 to user: Instance a425ac59-2ce8-4145-af01-95da3c5e4ecd could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:01:10.557799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1dd9b239-b231-4cfe-8b5d-b41a049168fa tempest-DeleteServersTestJSON-837152916 tempest-DeleteServersTestJSON-837152916-project] 10.222.0.17 "GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd" status: 404 len: 111 microversion: 2.1 time: 0.033579 Aug 11 10:01:10.557799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 101/208] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:10 2022] GET /compute/v2.1/servers/a425ac59-2ce8-4145-af01-95da3c5e4ecd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:01:10.638229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:10.649712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:10.649712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.649712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.649712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.650050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:10.650050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:10.650050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:10.818799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:10.826605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-05da71de-6f14-42f4-bf40-610f49972a38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.192414 Aug 11 10:01:10.838832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 108/209] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:10 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:11.848940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:11.849769 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:11.856562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:11.857093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:11.857528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:11.858942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:11.859906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:11.860633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:11.998926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:12.010827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3bfe2749-6798-4904-ac40-556936299469 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.165270 Aug 11 10:01:12.012439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 102/210] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:11 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:13.033167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:13.033922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:13.051354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:13.054140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:13.054140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:13.054140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:13.057725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:13.058178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:13.430361 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:13.438447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-81c947f9-7025-42d6-b7a3-d6f2269b325f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.409940 Aug 11 10:01:13.439630 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 109/211] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:13 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:14.460426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:14.463272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:14.469391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:14.470251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:14.471012 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:14.472055 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:14.472626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:14.473280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:14.697544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:14.723724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-892a9a80-4264-48ba-b623-63bd813e1a07 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.266626 Aug 11 10:01:14.723920 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 103/212] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:14 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:15.745856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:15.746486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:15.760266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:15.760266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:15.760266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:15.760266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:15.760853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:15.767355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:15.992222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:16.000493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cf3ae1f3-362c-4b33-892c-0557d1801b4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1522 microversion: 2.1 time: 0.258534 Aug 11 10:01:16.001080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 110/213] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:15 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:17.021050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:17.021702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:17.028294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:17.028784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:17.029297 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:17.029988 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:17.030440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:17.030888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:17.193171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:17.201433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c01a87ee-e9d3-48d0-aa3f-a3e6fb04217e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1502 microversion: 2.1 time: 0.184151 Aug 11 10:01:17.202212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 104/214] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:17 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:17.237165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:17.238205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:17.245496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:17.246002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:17.253910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:17.253910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:17.253910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:17.253910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:17.385869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:17.396182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6c0695b8-d21e-4ffb-947d-d926d45742de tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1517 microversion: 2.1 time: 0.165409 Aug 11 10:01:17.396915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 111/215] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:17 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:20.406206 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:20.408751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:20.415247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:20.415661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:20.416088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:20.416765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:20.417238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:20.417655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:20.441519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'flavor' on Instance uuid 17ab1218-d009-4e11-8813-b820e969974f {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:01:20.619152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:20.835588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc7d57a3-0542-43d1-9465-571d768d8b00 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/action" status: 200 len: 32 microversion: 2.1 time: 0.433094 Aug 11 10:01:20.852724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:20.855971 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:20.862285 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 105/216] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:01:20 2022] POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:01:20.869325 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:20.870040 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:20.870678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:20.871571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:20.874716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:20.883822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:21.042346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:21.051690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ce028a58-fed0-4c49-8cba-377de40a06fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.208597 Aug 11 10:01:21.052372 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 112/217] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:20 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:22.087909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:22.094212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:22.128747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:22.128747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:22.128747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:22.129570 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:22.130009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:22.130439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:22.439611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:22.451594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f6cedfdf-ef0f-4148-bb5d-32f36cf3f5c4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.379490 Aug 11 10:01:22.455177 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 106/218] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:22 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:23.473538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:23.476795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:23.507388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:23.512216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:23.512876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:23.513852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:23.514694 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:23.518751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:23.762027 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:23.785529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a39570d8-2902-4497-b542-a685acd05b38 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.300371 Aug 11 10:01:23.785529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 113/219] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:23 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:24.796583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:24.800210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:24.808080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:24.809852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:24.810335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:24.811327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:24.811793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:24.812273 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:24.841788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1f721ab3-1d09-4c40-8580-f0d7d751a020 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: .version_select at 0x7f787ccc6e50>, body: {"keypair": {"name": "tempest-keypair-1955756928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNW9pIDJmC0ABXnD7oAcouGCLi6EzxDjlo5C+HAgNJPz3F2PYxSoSAV/K3UJ+GtceQJYl/jMwgdOZ6rKaZYpfYVauDJ9uHWbQzmf5FcDLS2ABaGZJ7NFkCYuRkWLBB9rFw=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:24.862828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-1f721ab3-1d09-4c40-8580-f0d7d751a020 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:24.867178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-1f721ab3-1d09-4c40-8580-f0d7d751a020 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for user 6113630b377f40eda2f8994ae69633ab and project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:24.969704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:24.969927 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1f721ab3-1d09-4c40-8580-f0d7d751a020 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.385064 Aug 11 10:01:24.970735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 107/220] 10.222.0.17 () {62 vars in 1200 bytes} [Thu Aug 11 10:01:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 387 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 10:01:24.977599 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:24.983606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:24.985291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9cd84e26-c3f7-4eb3-b059-d88eb4bc6e9b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.190837 Aug 11 10:01:24.988202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 114/221] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:24 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:24.997688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:24.998805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:24.999445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:25.000674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:25.002028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:25.002499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:25.027831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-89a20941-b1fc-447d-8310-327023b70932 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/ips" status: 200 len: 145 microversion: 2.1 time: 0.056063 Aug 11 10:01:25.028545 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 108/222] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:01:24 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:26.007563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:26.008145 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:26.017728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:26.017728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:26.017728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:26.017728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:26.018153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:26.018762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:26.179641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:26.194903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2565b9dd-748f-4d7a-9360-b99309313540 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.191007 Aug 11 10:01:26.199958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 115/223] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:26 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:27.222225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:27.223815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:27.235566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:27.235566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:27.235566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:27.235566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:27.235929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:27.235929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:27.478220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:27.504573 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-406102db-d1e8-4453-a282-566aff5a253e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.285669 Aug 11 10:01:27.506009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 109/224] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:27 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:28.043541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-402870509", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47526419-e702-4fc0-88b1-4a49c2ddc321"}], "security_groups": [{"name": "tempest-securitygroup--1496771941"}], "key_name": "tempest-keypair-1955756928", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:28.258973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] validate_networks() for [('47526419-e702-4fc0-88b1-4a49c2ddc321', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:01:28.527066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:28.527671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:28.535084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:28.535443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:28.536096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:28.536809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:28.537335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:28.537672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:28.781759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:01:28.782773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:01:28.789596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:01:28.789596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:01:28.789596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:01:28.793210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:28.793744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:28.793948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:28.794299 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:28.795129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:28.795640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:28.796120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:28.807562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c8c709cf-ed2b-4234-9509-634189576269 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.284599 Aug 11 10:01:28.808378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 110/225] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:28 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:28.820127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:28.825236 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for user 6113630b377f40eda2f8994ae69633ab and project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:28.841388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:01:28.841388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:01:28.964000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3432b4ca-7b4e-44e6-b3f8-537484159da1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.925361 Aug 11 10:01:28.964737 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 116/226] 10.222.0.17 () {62 vars in 1188 bytes} [Thu Aug 11 10:01:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 11 10:01:28.976345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:28.977279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:29.045595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:29.053939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:29.055727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:29.056823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c26103ba-d2e7-45c2-9a6b-e4f1e09baef5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1281 microversion: 2.20 time: 0.084592 Aug 11 10:01:29.057558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 111/227] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:28 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:29.831419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:29.832907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:29.854355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:29.854921 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:29.857235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:29.857235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:29.857235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:29.857235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:29.899586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:29.900154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:29.906791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:29.910917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:29.910917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:29.910917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:29.910917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:29.911260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:29.936443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-84fd0e99-fc85-4a20-9582-b2d7c8773714 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/ips" status: 200 len: 149 microversion: 2.1 time: 0.040777 Aug 11 10:01:29.937049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 112/228] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:01:29 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:29.997509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:30.009309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-270fe83f-fa51-4c71-a8e8-fe6a707aebb9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.183421 Aug 11 10:01:30.009907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 117/229] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:29 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:30.082779 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:30.083376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:30.090047 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:30.090528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:30.090960 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:30.091672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:30.092099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:30.092518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:30.159946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:30.162408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ad355a0-531e-470e-8555-68589f87688a"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:30.164837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:30.168515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:30.170195 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:30.171298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ff265e52-f09e-4647-ad87-789f258464b9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1285 microversion: 2.20 time: 0.092511 Aug 11 10:01:30.171829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 113/230] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:30 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:30.175313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:30.175796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:30.176226 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:30.176949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:30.177433 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:30.177851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.035030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:31.035760 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:31.041676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.042153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.042576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.043562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.043990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.044412 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.116382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2abe56eb-bd6d-447a-bcb5-92d1af06d007 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956537 Aug 11 10:01:31.118225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 118/231] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:01:30 2022] POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:01:31.203445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:31.203577 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:31.214847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.216428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.217668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.218487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.219830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.222588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.232863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:31.241940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3c0e3aea-52b9-45d0-8147-8fa244e23186 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.214201 Aug 11 10:01:31.247327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 114/232] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:31 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:31.326692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:31.337870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:31.340042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:31.341669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-63e1a1d7-a14f-41b2-9b9e-64cb50e533e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1333 microversion: 2.20 time: 0.148669 Aug 11 10:01:31.342290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 119/233] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:31 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:31.836020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65078536-835b-4f46-a35b-45bdf1b5998f"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:31.838693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:31.849794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.850443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.850636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:31.851759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:31.853475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:31.854982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:32.268230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:32.269857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:32.277084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:32.277817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:32.278225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:32.279098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:32.279824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:32.280406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:32.526183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:32.535873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1905c0cd-2549-4cde-a869-e6f247a54978 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.272530 Aug 11 10:01:32.537538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 120/234] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:32 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:32.543723 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:32.544675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:32.551848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:32.558071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:32.558071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:32.558071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:32.558071 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:32.558764 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:32.621135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:32.631143 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:32.632991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:32.634152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1d80385c-7bb0-44f6-bd61-eea430f242a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1339 microversion: 2.20 time: 0.095381 Aug 11 10:01:32.634720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 121/235] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:32 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:33.257373 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-14ee958b-b742-4bf5-a90b-6addf4f35b0e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.424860 Aug 11 10:01:33.258567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 115/236] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:01:31 2022] POST /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 194 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:33.557692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:33.558162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:33.565629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:33.565914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:33.566350 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:33.567048 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:33.567531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:33.567947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:33.660645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:33.661431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:33.671783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:33.672630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:33.674108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:33.675445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:33.676115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:33.676810 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:34.063039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:34.071562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bbe3f872-815a-4547-9ce3-91bfbacb7135 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.517694 Aug 11 10:01:34.072305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 122/237] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:33 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:34.076984 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:34.091972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:34.096399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:34.096900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:34.102173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:34.103655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:34.105062 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:34.111060 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-69de4d11-c6a9-45eb-8860-ad4378233ffb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.456826 Aug 11 10:01:34.111643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 116/238] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:33 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:01:34.120289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] Creating event network-changed:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:01:34.127059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-1a96f1c2-b06d-4351-929f-277a689a9c25 req-5dd203dc-2ad0-4cc6-b30c-05dfe2a0d690 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052560 Aug 11 10:01:34.133392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 123/239] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:35.094361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:35.095119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:35.101562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:35.102040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:35.102464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:35.103144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:35.103589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:35.104005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:35.135286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:35.136142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:35.143431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:35.144202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:35.145101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:35.145903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:35.146461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:35.147036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:35.151485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:35.291840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:35.301137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2ec850ac-93f4-44cc-ba89-5d133fd3ef7d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.210401 Aug 11 10:01:35.301817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 117/240] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:35 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:35.321947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:35.330628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:35.332424 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:35.333590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f0c8c986-e0a4-4c3b-8b88-fcd799e16410 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.203470 Aug 11 10:01:35.334136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 124/241] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:35 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:01:36.325034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:36.326294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:36.337932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:36.339960 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:36.342795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:36.343782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:36.344379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:36.345192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:36.373827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:36.376282 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:36.379840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:36.394979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:36.394979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:36.394979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:36.396197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:36.397075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:36.397958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:36.598728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:36.612063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-edbec80f-e922-4b3c-850f-1b61d0335ff6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.292144 Aug 11 10:01:36.632370 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 118/242] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:36 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:36.684277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:36.693377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:36.695046 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:36.696405 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f927152d-9b15-4767-972b-d77b9a29ce96 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.341373 Aug 11 10:01:36.697367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 125/243] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:36 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:37.642524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:37.660392 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:37.669191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:37.684340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:37.686245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:37.686245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:37.686245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:37.688706 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:37.689495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:37.726982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:37.727419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:37.743068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:37.749810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:37.749810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:37.749810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:37.750756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:37.751239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:37.956208 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:37.965517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e7e4a85b-c838-40fe-9d32-2dca2662b8a8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.326957 Aug 11 10:01:37.966439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 119/244] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:37 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:37.987237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:38.010798 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:38.012236 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:38.013486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c80c1504-bfcd-4eaa-9b3f-64c826d5ecc5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.293916 Aug 11 10:01:38.014077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 126/245] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:37 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:38.986368 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:38.986973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:38.997579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:38.998172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:38.998751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:38.999624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:39.000196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:39.001160 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:39.037564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:39.038257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:39.042907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:39.043957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=6 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:39.049158 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:39.049944 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:39.050525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:39.050663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=6 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:39.051484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:39.052077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:39.052856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:39.227161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:39.236038 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-18c67de8-22bc-4c29-b553-1a9662b68ce9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.253498 Aug 11 10:01:39.236978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 120/246] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:38 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:39.267730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:39.275844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:39.277357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:39.278669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8a108ad7-0786-41be-abed-e64142f873d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.245332 Aug 11 10:01:39.279231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 127/247] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:39 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:39.720817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "name": "network-vif-plugged", "status": "completed", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:39.734922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:39.735970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:39.736572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:39.749358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] Creating event network-vif-plugged:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:01:39.754900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-62b5b971-c9d1-4002-8b71-939bf0a886ac req-40abca4a-b1cf-47c8-8ab6-663c2e1d26de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038373 Aug 11 10:01:39.755588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 121/248] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:40.140494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:40.151582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.152332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.152778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.225241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Going to try to stop instance {{(pid=121197) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 10:01:40.258799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:40.259525 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:40.269693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.270281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.273247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.273247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.273247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.273247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.429456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:40.445270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-76d8621c-bdc0-49b3-bae3-16985167c110 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action" status: 202 len: 0 microversion: 2.1 time: 0.308481 Aug 11 10:01:40.450039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 128/249] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:01:40 2022] POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:01:40.450394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a9897d90-a486-4f0f-a827-60029c1d2cad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.195822 Aug 11 10:01:40.450870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 122/250] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:40 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:40.456750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:40.457713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:40.465083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.465783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.466263 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.467076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.467702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.468303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.470706 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:40.471377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:40.477461 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.478072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.478602 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.479393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:40.480093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:40.480556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:40.678271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:40.685291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:40.686355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:40.688646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:40.689804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:40.689925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0bcebba6-5b21-45f3-bdc0-9abeae715c18 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.239748 Aug 11 10:01:40.690368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 129/251] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:40 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:40.695743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-670bec3a-845a-4c9b-a922-af19f18141c2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.233848 Aug 11 10:01:40.696406 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 123/252] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:40 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:41.474934 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:41.475543 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:41.482099 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.482752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.483287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.483970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.484419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.484922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.623029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:41.631242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9bc1df0b-9f27-4f6c-a905-e059f6a8e30e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1503 microversion: 2.1 time: 0.160346 Aug 11 10:01:41.631861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 130/253] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:41 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:41.652487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5bdc65f-0057-46eb-be5a-deef699ee9b7"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:41.654865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:41.662535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.663013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.663444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.664127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.664569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.664989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.689222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] HTTP exception thrown: Cannot 'attach_volume' instance 17ab1218-d009-4e11-8813-b820e969974f while it is in vm_state rescued Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Request method failure captured: Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/os-volume_attachments HTTP/1.1 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 74 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMQjZw7kFhz9g7LEJQsP-iH5ffu3I5awbWKeum2tTjFcw3C92yp9ymdQrILi1Kq0kmatFh7l0U91YYXlb0PpqBeC2XutFi7zptgUJkrKAnWo3607IitA058X3blz5YHT6Gbo8pnhbBDlUvY-ZXSxdNxrzfbTHo4fBh42H3Qm6AxpaM Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:01:41.691131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: c62f05ea732142c1af1c09dd23e7b9a3 Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {"volumeAttachment": {"volumeId": "c5bdc65f-0057-46eb-be5a-deef699ee9b7"}} Aug 11 10:01:41.692585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Cannot 'attach_volume' instance 17ab1218-d009-4e11-8813-b820e969974f while it is in vm_state rescued Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'server_id': '17ab1218-d009-4e11-8813-b820e969974f', 'body': {'volumeAttachment': {'volumeId': 'c5bdc65f-0057-46eb-be5a-deef699ee9b7'}}} Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17ab1218-d009-4e11-8813-b820e969974f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:01:41.696650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 17ab1218-d009-4e11-8813-b820e969974f while it is in vm_state rescued Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:01:41.698048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 17ab1218-d009-4e11-8813-b820e969974f while it is in vm_state rescued Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Returning 409 to user: Cannot 'attach_volume' instance 17ab1218-d009-4e11-8813-b820e969974f while it is in vm_state rescued {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-85542974-513f-4965-b74f-57ff25ddb348 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044329 Aug 11 10:01:41.699253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 124/254] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:01:41 2022] POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 11 10:01:41.706499 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:41.706499 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:41.710843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.712663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.712663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.712864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.713313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.713994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.715129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:41.715850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:41.723560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.724255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.724635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.725608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.726027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.726555 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.971185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c126ab14-a24e-408f-8201-008dd53e893e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/action" status: 202 len: 0 microversion: 2.1 time: 0.272788 Aug 11 10:01:41.972378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 131/255] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:01:41 2022] POST /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:01:41.982657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:41.983413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:41.991761 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.992314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:41.993473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:41.994281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:41.994774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:42.009563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:42.019732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:42.030021 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:42.033004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:42.034479 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-87197abf-021f-4298-99cb-dcd01d0ccdcf tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1407 microversion: 2.20 time: 0.324241 Aug 11 10:01:42.037636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 125/256] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:41 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:01:42.040576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:42.041680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:42.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:42.049543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:42.050736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:42.051946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:42.052620 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:42.053335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:42.234566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:42.245138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4a676216-6bfe-4d22-9c16-fd14626e67a7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.271170 Aug 11 10:01:42.246181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 132/257] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:41 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:42.257659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:42.265123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c0dbe928-f68e-4949-bbb2-d9d4d9f48183 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1511 microversion: 2.1 time: 0.228871 Aug 11 10:01:42.265686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 126/258] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:42 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:43.059269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:43.059868 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:43.066926 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.067407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.067843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.069548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.070028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.070460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.269254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:43.269777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:43.277515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.278009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.278445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.279165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.279635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.280061 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.299903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:43.308197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:43.309757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:43.310928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9001365f-5815-4b56-9c89-bbbd8bf37b7d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1599 microversion: 2.20 time: 0.255674 Aug 11 10:01:43.311496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 133/259] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:01:43 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:01:43.316298 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:43.316892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:43.326895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.327666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.328227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.329881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.330482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.331043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.514732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:43.523404 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0a13aa51-8b6a-422b-88ef-e51f6bb78ce9 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.259020 Aug 11 10:01:43.523970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 127/260] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:43 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:43.528972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:43.529131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:43.535117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.535604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.551978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.551978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:43.551978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:43.551978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:43.698120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f992a225-98d7-4425-baf7-69327a89ff3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.173066 Aug 11 10:01:43.698748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 128/261] 10.222.0.17 () {60 vars in 1316 bytes} [Thu Aug 11 10:01:43 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:01:43.748245 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:43.761169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-25655a43-4d56-4b81-87d1-2413e81c9d8d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1511 microversion: 2.1 time: 0.448435 Aug 11 10:01:43.761835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 134/262] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:43 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:44.545056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:44.545685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:44.553525 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:44.554267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:44.554699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:44.555403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:44.555855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:44.556300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:44.714349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:44.724261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2243f6f8-ed86-4fed-a060-1b5a8da8008e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.183860 Aug 11 10:01:44.729842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 129/263] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:44 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:44.783503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:44.784774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:44.797150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:44.802511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:44.803959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:44.803959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:44.809542 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:44.810149 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:45.000975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:45.013905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:45.014534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:45.015203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:45.027366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] Creating event network-changed:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:01:45.033381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-fcb5d0ec-7bdb-432e-ad6d-0158aada6292 req-0c8aa30c-fac3-45be-b464-db973b40c625 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037376 Aug 11 10:01:45.034443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 130/264] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:45.188026 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:45.197109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d0faf89d-e254-4148-b932-6c243a0dc2c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1511 microversion: 2.1 time: 0.417998 Aug 11 10:01:45.197783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 135/265] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:44 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:45.757456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:45.758424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:45.765407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:45.767607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:45.767607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:45.767793 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:45.768240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:45.768664 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:45.982906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:45.992799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-eda257d8-7376-44d6-960f-242c44992f12 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.250372 Aug 11 10:01:45.993789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 131/266] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:45 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:46.218389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:46.218983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:46.225949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:46.226422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:46.226850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:46.227531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:46.227972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:46.228388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:46.404908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:46.413547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1a474642-9561-4121-903c-311ab753da7e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1511 microversion: 2.1 time: 0.198847 Aug 11 10:01:46.414429 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 136/267] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:46 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:47.014028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:47.014576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:47.021689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:47.022219 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:47.022681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:47.023372 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:47.023818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:47.024235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:47.156103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:47.164235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f405dd59-2d8a-49ff-8eab-dd71b2b686fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.154322 Aug 11 10:01:47.164792 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 132/268] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:47 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:47.437670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:47.439737 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:47.446942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:47.447421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:47.448017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:47.448723 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:47.450012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:47.450436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:47.664224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:47.673525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-44ea228c-8256-4bda-b730-e6fc81d5336f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1517 microversion: 2.1 time: 0.240596 Aug 11 10:01:47.674641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 137/269] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:47 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:48.191489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:48.192092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:48.199041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:48.199524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:48.199956 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:48.200641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:48.201115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:48.201730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:48.359354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:48.370031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3af76cf6-8866-4e8c-b456-5d0a8b399f86 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.188567 Aug 11 10:01:48.370824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 133/270] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:48 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:48.651609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7ec01638-9021-4302-9de4-e1a7b0dcf715 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: .version_select at 0x7f787c3a3670>, body: {"keypair": {"name": "tempest-keypair-540801225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdf0sz090YY+ME4PcknMHLZIw+LepH66m7Ht5glMyr4Q4HrVSwW8C+bF0Zw/d79Tf9PcQ/5PNMQZj3sZHjWLjkFwpHSjJSO1jG9hFbpin2RseCSvr/Rr7cOilzG0YQHQQ=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:48.668112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-7ec01638-9021-4302-9de4-e1a7b0dcf715 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:48.672261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-7ec01638-9021-4302-9de4-e1a7b0dcf715 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:48.756742 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7ec01638-9021-4302-9de4-e1a7b0dcf715 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109462 Aug 11 10:01:48.757519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 138/271] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:01:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:49.392740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:49.394474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:49.404856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:49.405669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:49.406294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:49.408044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:49.409122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:49.409712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:49.543327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b9c4cb59-2ddb-4a0e-a8a6-8d00e28b8b2e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: .version_select at 0x7f787c439040>, body: {"keypair": {"name": "tempest-keypair-149107346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV85PaQ3i60e1Fxvg6bv8WlqTBMXTg6c2Ad/CUrSzdvRjfEP/luhiz2+ZjRgGDnzXPEFO8aEmXQRtQWfiGsmopu2o+BFeS2ly5KY6UHSC0KuJ0pGmOH61BNHh6fOdtPaA=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:49.562459 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-b9c4cb59-2ddb-4a0e-a8a6-8d00e28b8b2e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:49.568003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-b9c4cb59-2ddb-4a0e-a8a6-8d00e28b8b2e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for user c62f05ea732142c1af1c09dd23e7b9a3 and project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:49.620937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:49.640040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-224eb450-d578-4a50-acf9-cc8542c85d6c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.251669 Aug 11 10:01:49.641503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 134/272] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:49 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:49.664976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b9c4cb59-2ddb-4a0e-a8a6-8d00e28b8b2e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125626 Aug 11 10:01:49.667716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 139/273] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:01:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:50.664272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:50.665165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:50.681322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:50.689766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:50.690569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:50.691639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:50.692163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:50.692908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:50.878867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:50.887366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-47af9afc-7022-4271-a477-8c973d58bbaa tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.227509 Aug 11 10:01:50.887930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 135/274] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:50 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:51.413847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419311934", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d20a0340-e393-4428-8a14-1335a616fcac"}], "security_groups": [{"name": "tempest-securitygroup--926476963"}], "key_name": "tempest-keypair-540801225", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:51.533712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] validate_networks() for [('d20a0340-e393-4428-8a14-1335a616fcac', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:01:51.912585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:51.918594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:51.922040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:51.923718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:51.924221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:51.925909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:51.926359 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:51.926790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:51.943302 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:01:51.948070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:01:51.948070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:01:51.948070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:01:51.948070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:01:51.955943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:51.956501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:51.957036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:51.957893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:51.958538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:51.959592 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:51.980351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:51.985512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:51.997191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:01:51.999584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:01:52.093645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:52.102671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5fb6fa38-62e9-4a1f-bb2a-2679f5f704fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.196623 Aug 11 10:01:52.103243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 136/275] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:51 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:52.158166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a6f2ec4-c49c-407f-827b-af2b9e49ec13 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749076 Aug 11 10:01:52.158972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 140/276] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:01:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:01:52.170317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-41f61a31-842d-448b-bbb8-7e13736b5c38 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:52.171168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-41f61a31-842d-448b-bbb8-7e13736b5c38 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:52.236410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-41f61a31-842d-448b-bbb8-7e13736b5c38 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:52.237552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-31632458", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "077e1416-1a08-4f10-a088-a425d2677f36"}], "security_groups": [{"name": "tempest-securitygroup--1390156173"}], "key_name": "tempest-keypair-149107346", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:52.243216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-41f61a31-842d-448b-bbb8-7e13736b5c38 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1240 microversion: 2.1 time: 0.076949 Aug 11 10:01:52.244023 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 137/277] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:52 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:52.360912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] validate_networks() for [('077e1416-1a08-4f10-a088-a425d2677f36', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:01:52.750382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:01:52.751065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:01:52.751564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:01:52.751970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:01:52.752772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:01:52.764133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:52.764133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:52.764133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:52.764972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:52.765476 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:52.765916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:52.785349 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:01:52.789294 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Getting quotas for user c62f05ea732142c1af1c09dd23e7b9a3 and project 75fb7bc39c364a5fb80532cbd3b2f654. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:01:52.801864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:01:52.804022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:01:52.944496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b05093ed-4468-456b-a670-f97e81fe2c0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.711860 Aug 11 10:01:52.945352 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 141/278] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:01:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:01:52.958905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5dbb0b32-574f-4736-a00b-5d6b467d701c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:52.959680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5dbb0b32-574f-4736-a00b-5d6b467d701c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:53.024800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5dbb0b32-574f-4736-a00b-5d6b467d701c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:53.032997 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5dbb0b32-574f-4736-a00b-5d6b467d701c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1243 microversion: 2.1 time: 0.080737 Aug 11 10:01:53.033515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 138/279] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:52 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1243 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:53.123815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:53.124422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:53.130985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:53.132118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:53.132563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:53.133292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:53.133801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:53.134227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:53.138410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:53.269559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:53.270565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:53.277718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:53.278280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:53.278722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:53.279434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:53.279892 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:53.280320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:53.315157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:53.326108 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd2a6ced-50c9-4f29-b391-705123e9bfbd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.206264 Aug 11 10:01:53.327031 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 142/280] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:53 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:53.352153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:53.360879 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-42ec9b08-9191-47c4-9c48-fa9cd36b3bcf tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1244 microversion: 2.1 time: 0.099496 Aug 11 10:01:53.362250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 139/281] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:53 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:54.053772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:54.054365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:54.062353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.063178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.063628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.064305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.064755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.065199 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.130873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:54.138649 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-92bb35c4-869c-499f-a8b2-554bc7b13ec5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1247 microversion: 2.1 time: 0.088667 Aug 11 10:01:54.139228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 143/282] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:54 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:54.350344 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:54.352057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:54.359785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.360683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.361260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.361993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.362453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.362887 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.383315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:54.383922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:54.390403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.391538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.392390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.393122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:54.393703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:54.394328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:54.481042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:54.499958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-84ae5ac0-304f-461f-abf6-57064ab846a9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1292 microversion: 2.1 time: 0.115894 Aug 11 10:01:54.499958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 144/283] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:54 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:01:54.541809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:54.550443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fda78e51-5af1-480a-ba54-db776dc55fae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.206211 Aug 11 10:01:54.551014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 140/284] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:54 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:55.159228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:55.163065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:55.167449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.167914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.168360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.169106 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.169549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.169962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.254401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:55.261855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e57782e5-3ef6-4c17-9fce-5ef81b1e9fb1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1239 microversion: 2.1 time: 0.106677 Aug 11 10:01:55.262429 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 145/285] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:55 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:55.521942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:55.522618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:55.530943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.532438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.533358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.534401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.535125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.535764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.571589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:55.572205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:55.578570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.580473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.580473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.581059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:55.581710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:55.582325 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:55.651334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:55.660268 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2b3ec6b8-7e69-4d85-8950-69efa4e499ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1310 microversion: 2.1 time: 0.142630 Aug 11 10:01:55.661705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 141/286] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:55 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:55.765818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:55.773945 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7aad594e-6b80-4c8d-815b-98a88f44c994 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.206229 Aug 11 10:01:55.779968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 146/287] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:55 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:56.285380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:56.286142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:56.295684 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.295876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.296464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:56.297298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.297824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.298314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:56.408818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:56.422576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-93e6c87f-6c74-4ec3-8c29-f1c6c57b2e5e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1303 microversion: 2.1 time: 0.139078 Aug 11 10:01:56.422576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 142/288] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:56 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:56.682647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:56.684390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:56.695009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.697826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.699122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:56.699355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.700036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.700938 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:56.799536 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:56.801077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:56.830108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.831822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.833669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:56.834980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:56.835574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:56.837233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:57.079808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:57.091660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-84553562-b0ee-4310-96aa-78dd3cb4770d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.413185 Aug 11 10:01:57.095217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 147/289] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:56 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:57.255615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:57.261965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:57.264833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-775e7b3b-0b4c-4454-abe9-9486891ecc6f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.472795 Aug 11 10:01:57.266312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 143/290] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:56 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:57.446894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:57.447972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:57.461076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:57.464744 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:57.464744 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:57.464744 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:57.464744 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:57.465739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:57.839648 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:57.852433 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-657447dd-141e-4a69-9723-252e4894ed70 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.410485 Aug 11 10:01:57.864730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 148/291] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:57 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:58.116957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:58.118266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:58.126515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.134013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.134470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.136700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.137196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.137625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.292034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:58.293053 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:58.295448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:58.303347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.304201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.304860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.306246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.307745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.308466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.315615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:58.330250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c057d771-0cbd-4de9-8416-c67d5677340c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.218997 Aug 11 10:01:58.331137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 144/292] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:58 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:58.346398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:58.370018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.370018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.370018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.382959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] Creating event network-changed:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:01:58.390226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-30944eaa-494e-4974-b5c9-5ca137e597b9 req-e2485ff4-a419-4deb-9b0c-8a71408ecacc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055172 Aug 11 10:01:58.391354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 145/293] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:58.397335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40073569-0bde-4157-8824-48a436788df4", "tag": "85a49c50-fe6c-4093-9187-765871b4466f"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:01:58.410028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.411425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.411425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.424357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] Creating event network-changed:85a49c50-fe6c-4093-9187-765871b4466f for instance 40073569-0bde-4157-8824-48a436788df4 on hv-cinder-81566 Aug 11 10:01:58.429703 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-c313a09c-6437-416a-befd-c892cb7f36ca req-95dc77be-0c8e-4110-9aac-0a56fda2c63f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036956 Aug 11 10:01:58.430889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 146/294] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:01:58.560642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:58.570110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-76be1a4a-48ab-45c1-9f16-bdb64cc45d50 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.285962 Aug 11 10:01:58.571021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 149/295] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:58 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:58.874918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:58.875693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:58.881950 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.882431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.882867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:58.884488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:58.884488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:58.884488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:59.086276 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:59.095630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-597ae25b-f92b-4c9d-b629-4dec3fb08c79 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.224928 Aug 11 10:01:59.108841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 147/296] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:58 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:59.354880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:59.356187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:59.367551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:59.368208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:59.368795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:59.369738 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:59.371209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:59.371899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:59.521486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:59.528853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b7f352d8-5578-4b4d-8df7-ca94f5fea9c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.178440 Aug 11 10:01:59.541223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 150/297] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:59 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:01:59.591472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:01:59.592676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:01:59.600252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:59.601130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:59.601752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:59.602461 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:01:59.602928 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:01:59.603447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:01:59.733366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:01:59.742323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c71698f1-7595-4543-aa2e-55a80ad887e1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.155156 Aug 11 10:01:59.742878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 148/298] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:01:59 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:00.125837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:00.125837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:00.134834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.135719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.136445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.137539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.138308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.139024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.288212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:00.295866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c922ca80-096c-4d01-99bf-5337711e3103 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.183676 Aug 11 10:02:00.296421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 151/299] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:00 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:00.550160 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:00.550678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:00.556841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.557356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.557822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.559016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.559016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.559385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.689638 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:00.697278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3ab98b96-e717-45be-9c2d-80ef6ac01cce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.151714 Aug 11 10:02:00.697836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 149/300] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:00 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:00.764016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:00.764621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:00.770582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.771066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.771496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.772177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:00.772632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:00.773090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:00.902601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:00.911247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ced5ed94-dfc9-4970-b73f-42e0132db54d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.151083 Aug 11 10:02:00.911804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 152/301] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:00 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:01.304394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1110791097", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "networks": [{"uuid": "f03007b8-fe93-4ccc-856a-1cad152aea8b"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:01.315937 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:01.316541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:01.322901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:01.323476 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:01.323959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:01.325137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:01.325137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:01.325511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:01.358226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] validate_networks() for [('f03007b8-fe93-4ccc-856a-1cad152aea8b', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:02:01.544422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:01.553061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2047f5f1-65af-45f5-81ef-d9cfddf8d519 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.241076 Aug 11 10:02:01.553643 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 153/302] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:01 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:01.719367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:01.721952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:01.726186 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:01.726748 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:01.727268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:01.728025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:01.728650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:01.729128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.043426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:02:02.043880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:02:02.044277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:02:02.044680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:02:02.045116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:02:02.053919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.054395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.054822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.055539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.055984 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.056400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.072947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:02.073782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Getting quotas for project dd2a37c402a64171aae8a8c90b89ce33. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:02:02.077880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Getting quotas for user acd4018e26564721a8c16db0e9d2e0aa and project dd2a37c402a64171aae8a8c90b89ce33. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:02:02.084866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3e00e25a-b39c-43e6-b699-048abd7a9ce6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.369875 Aug 11 10:02:02.098017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 154/303] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:01 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:02.100154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:02:02.102198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:02:02.105882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:02.106634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:02.113839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.114399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.114901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.115660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.116290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.116719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.208992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f6f7ea4c-79f4-475c-b85b-98abaa118ed6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908381 Aug 11 10:02:02.209802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 150/304] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:02:02.221007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0663353e-1db5-4319-bd92-a02c7c4bd9d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:02.222262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0663353e-1db5-4319-bd92-a02c7c4bd9d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:02.344089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0663353e-1db5-4319-bd92-a02c7c4bd9d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:02.356597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0663353e-1db5-4319-bd92-a02c7c4bd9d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1219 microversion: 2.1 time: 0.139454 Aug 11 10:02:02.357496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 151/305] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:02 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:02.472305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:02.483904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ec2fc95e-eeba-4358-9dbc-d5cf32ff8c20 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1723 microversion: 2.1 time: 0.384553 Aug 11 10:02:02.484849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 155/306] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:02 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:02.574442 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:02.575156 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:02.582271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.585976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.585976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.585976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:02.585976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:02.586362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:02.790501 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:02.799322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-21e864cb-b94b-42f0-a85e-fb37a5f213fe tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.228775 Aug 11 10:02:02.804420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 152/307] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:02 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:03.110093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:03.110697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:03.112539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=4 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:03.113253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=20 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:03.118043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.118511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.129445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.129445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.129445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.129445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.267484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:03.276471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cfdb69d7-4025-4f00-bf80-2e8d457d3f1d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.170718 Aug 11 10:02:03.284019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 156/308] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:03 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:03.378277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-771094d3-8b86-4295-a11d-f97ebbaa6ed3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:03.378793 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-771094d3-8b86-4295-a11d-f97ebbaa6ed3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:03.430800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-771094d3-8b86-4295-a11d-f97ebbaa6ed3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:03.443014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-771094d3-8b86-4295-a11d-f97ebbaa6ed3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1219 microversion: 2.1 time: 0.069404 Aug 11 10:02:03.443655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 153/309] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:03 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:03.507390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:03.508017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:03.516919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.517829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.518257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.518952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.519399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.519827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.660942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:03.669569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fe8d54e2-7d1c-472c-975c-98a2d905e84d tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1700 microversion: 2.1 time: 0.167042 Aug 11 10:02:03.670149 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 157/310] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:03 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:03.690926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:03.697407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.697889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.698319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.759774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Going to try to start instance {{(pid=121196) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 10:02:03.820352 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:03.821336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:03.829108 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.829599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.830031 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.830824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.831725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.832165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.967118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b68a019a-3419-4c3e-bbe8-642549026fa2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action" status: 202 len: 0 microversion: 2.1 time: 0.280388 Aug 11 10:02:03.972024 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 154/311] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:02:03 2022] POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:02:03.977850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "name": "network-vif-plugged", "status": "completed", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:03.991413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:03.992125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:03.993562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:03.995964 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:04.000213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:04.006863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] Creating event network-vif-plugged:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:02:04.007433 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a2137287-2074-4f33-b8e7-0417d49fd161 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.190811 Aug 11 10:02:04.008084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 158/312] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:03 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:04.011726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-339d72c1-6535-4be9-9de0-bfb63d42dfc4 req-cf46a21c-a687-4b2e-9547-e5d58638106f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038034 Aug 11 10:02:04.012600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 155/313] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:04.013600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:04.015036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:04.021491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.022090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.023424 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.024537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.025281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.025905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.182715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:04.201870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7bd86415-6807-437e-a4ba-c9b8817c8fa5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.192614 Aug 11 10:02:04.202584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 159/314] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:04 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:04.298296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:04.299276 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:04.305672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.313356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.313356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.313356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.313356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.313824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.465122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:04.465735 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:04.472396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.472882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.473546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.474296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:04.474976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:04.475406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:04.516801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:04.525474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-95e22cc1-ad13-40a0-8f04-95a588f53def tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.231738 Aug 11 10:02:04.526067 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 156/315] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:04 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:04.559735 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:04.568340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e6a34329-a97d-4e34-8db0-281a557c0a76 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1271 microversion: 2.1 time: 0.108377 Aug 11 10:02:04.568918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 160/316] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:04 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:05.029177 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:05.029781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:05.036811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.037316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.037749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.038434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.038888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.039309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.224307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:05.225688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:05.232239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.232987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.233664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.235113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.235866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.236484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.237788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:05.247057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7df9c239-47ec-454b-8bbe-20d5da7702f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.221554 Aug 11 10:02:05.247951 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 157/317] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:05 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:05.381780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:05.389837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-44cc9249-d993-4f45-808d-30557b2922d3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.169375 Aug 11 10:02:05.390424 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 161/318] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:05 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:05.546468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:05.547692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:05.549784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:05.554506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.554986 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.555420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.556109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.556568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.557083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.590469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:05.591113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:05.603103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.610020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.610020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.610020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:05.610020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:05.610565 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:05.708144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:05.720645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd754b11-19a1-4735-9257-80391418aabc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1279 microversion: 2.1 time: 0.134377 Aug 11 10:02:05.721708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 162/319] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:05 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:05.796428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:05.804053 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-43c4e722-d3ef-4869-9183-531786c8be53 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.261618 Aug 11 10:02:05.804619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 158/320] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:05 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:06.031549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40073569-0bde-4157-8824-48a436788df4", "name": "network-vif-plugged", "status": "completed", "tag": "85a49c50-fe6c-4093-9187-765871b4466f"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:06.041466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.042173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.042602 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.059396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] Creating event network-vif-plugged:85a49c50-fe6c-4093-9187-765871b4466f for instance 40073569-0bde-4157-8824-48a436788df4 on hv-cinder-81566 Aug 11 10:02:06.065245 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-3af4af33-e525-47d2-8f66-e107d9eb3cf5 req-2e54dfe0-ba03-4b03-bb89-89aa5a49f902 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 Aug 11 10:02:06.065929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 163/321] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:06.274163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:06.274163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:06.278164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.278654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.279091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.279791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.280254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.280678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.412288 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:06.412962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:06.418004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:06.420089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.420089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.420664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.421387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.422797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.423055 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.426715 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0f5da4d1-e8b8-409d-8fef-f0bef3aa0dae tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.162451 Aug 11 10:02:06.427283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 159/322] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:06 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:06.554886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:06.563900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-609526aa-8d9a-4eb6-96f7-ac57768bc97a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.156429 Aug 11 10:02:06.564467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 164/323] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:06 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:06.741367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:06.741923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:06.747790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.748262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.748689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.749507 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.750161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.750586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.825285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:06.825897 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:06.832633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.833145 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.833586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.834305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:06.834756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:06.835180 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:06.885702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:06.893722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ce2fda10-7e62-40a5-9f78-625fd9d43a85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1331 microversion: 2.1 time: 0.156224 Aug 11 10:02:06.894307 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 160/324] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:06 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:06.974763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:06.982537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-baa18c41-2bb0-443a-8031-fcd468de337b tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.161133 Aug 11 10:02:06.983093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 165/325] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:06 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:07.448272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:07.448789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:07.455724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.456197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.456622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:07.457320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.457766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.458185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:07.585277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:07.586194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:07.586315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:07.592443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.592925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.593426 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:07.594040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1f21fc91-6e21-4c80-903a-4b05a37da36e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.149584 Aug 11 10:02:07.594155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.594599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.595016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 161/326] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:07 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:07.595140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:07.727008 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:07.734891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-03cd477f-ad92-41ca-b7ce-bf095507c030 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.153561 Aug 11 10:02:07.735448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 166/327] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:07 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:07.914889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:07.915495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:07.921445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.922530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.923010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:07.923748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:07.924201 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:07.924621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.004725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:08.005200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:08.012416 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.012906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.013360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.014051 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.014505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.014952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.066762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:08.074247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d2782ebd-35a9-42cf-8629-c7b18ba73d91 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1331 microversion: 2.1 time: 0.163344 Aug 11 10:02:08.074818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 162/328] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:07 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1331 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:08.151394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:08.159139 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bd991fdc-3ce7-4e84-82ee-b14f7abe5ef4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.159173 Aug 11 10:02:08.159708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 167/329] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:07 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:08.614774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:08.615382 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:08.622139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.622623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.623062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.623748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.624207 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.624660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.751549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:08.755573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:08.756202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:08.758918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8b7f65e6-839a-41c8-a397-fd13177d4008 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1369 microversion: 2.1 time: 0.147988 Aug 11 10:02:08.759471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 163/330] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:08 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:08.762339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.762826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.763265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.763956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:08.764407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:08.764829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:08.891135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:08.899105 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ff6c0a45-0a14-436e-85df-7abdd6bce9fb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.147311 Aug 11 10:02:08.899672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 168/331] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:08 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:09.094541 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:09.095148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:09.102187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.103114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.103552 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.104696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.105203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.105632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.110740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:09.180352 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:09.181410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:09.191155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.191826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.197120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.197120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.197120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.197120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.289489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:09.299675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cddc7768-451b-45f0-b1d8-ff226a9f4d4d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.209161 Aug 11 10:02:09.300811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 164/332] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:09 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:09.358070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:09.371586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a833f970-4a40-4dac-8e1d-16a0c1b59db9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.195290 Aug 11 10:02:09.372175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 169/333] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:09 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:09.780452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:09.781607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:09.788520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.789088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.789975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.790151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.791656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.791656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.920329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:09.920932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:09.927842 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.928814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.928814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.929430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:09.929872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:09.930285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:09.966752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:09.975364 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cd6b135a-03be-41bf-876b-6e453c25d9f6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1563 microversion: 2.1 time: 0.199123 Aug 11 10:02:09.975865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 165/334] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:09 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:09.997633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:09.998173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:10.012133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.012133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.012133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.012133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.013042 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.013042 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.126826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2623086f-fda1-4b28-a062-8306eb15aa64 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134753 Aug 11 10:02:10.127590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 166/335] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:02:09 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:10.131849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:10.132778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc825882-520d-43ba-bfbb-86039a4e2236", "tag": "a9c76001-b3fb-484d-ac4d-9ea310b35ca4"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:10.139884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1ef42160-ae43-4bfe-810d-e01c29831ea7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1709 microversion: 2.1 time: 0.223277 Aug 11 10:02:10.145064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 170/336] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:09 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:10.145250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.145250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.145250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.155308 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] Creating event network-changed:a9c76001-b3fb-484d-ac4d-9ea310b35ca4 for instance fc825882-520d-43ba-bfbb-86039a4e2236 on hv-cinder-81566 Aug 11 10:02:10.161181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-2fa954cc-e612-4fb1-9401-0e8b217c037b req-5411e94a-8214-4a44-a60b-6e20c47909dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032277 Aug 11 10:02:10.161916 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 167/337] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:10.322203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:10.322796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:10.330241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.330915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.331337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.332019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.332466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.332877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.393565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:10.394254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:10.400370 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.400883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.401333 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.402020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:10.402468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:10.403000 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:10.541204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:10.549058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9634ce8e-83d8-4f8d-b01b-374def07bba6 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.230686 Aug 11 10:02:10.550114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 171/338] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:10 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:10.570005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:10.577471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1a23893f-5a75-4669-9fc1-575eba7ac775 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.188878 Aug 11 10:02:10.585778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 168/339] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:10 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:11.166903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:11.167507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:11.177759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.178255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.178693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.179392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.179847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.180271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.411414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:11.419746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-43ead906-ad6f-4bbe-9f17-a2927eb7487a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1713 microversion: 2.1 time: 0.261701 Aug 11 10:02:11.420306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 172/340] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:11 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1713 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:11.570377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:11.570982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:11.579634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.579634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.579634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.579634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.580018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.580258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.600058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:11.600818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:11.607242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.607887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.608437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.609454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:11.610283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:11.610815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:11.775251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:11.785560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-09206504-9f1a-4597-8b75-2abe0ad7c1ee tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.218866 Aug 11 10:02:11.786460 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 169/341] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:11 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:11.798348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:11.807235 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-10545d2e-b915-41ab-904d-04bf0231c4e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1365 microversion: 2.1 time: 0.211309 Aug 11 10:02:11.807806 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 173/342] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:11 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:12.183719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:12.188825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:12.195077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:12.195289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:12.195715 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:12.207674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] Creating event network-changed:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:02:12.212644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-3fb4721a-f77d-4496-b6ce-cee00461dce3 req-51c39eb9-f43a-4ad3-aee7-9cdc8b79ff6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032643 Aug 11 10:02:12.213424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 170/343] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:12.806642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:12.807239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:12.814613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:12.815094 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:12.815522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:12.816208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:12.816657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:12.817103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:12.829890 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:12.830618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:12.838082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:12.844300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:12.844300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:12.844300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:12.844300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:12.844675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:13.298626 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:13.310057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cc44af3b-e9a6-4c1e-9748-5f96a68f6247 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.506755 Aug 11 10:02:13.311159 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 174/344] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:12 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:13.334046 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:13.341710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e62f41f3-e6c2-4146-bb9f-9ded8633f75f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1556 microversion: 2.1 time: 0.516892 Aug 11 10:02:13.345420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 171/345] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:12 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1556 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:13.362589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:13.363115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:13.369089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:13.369578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:13.370012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:13.370695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:13.371200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:13.371623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:13.450900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f970e6dc-b218-4a8f-9396-0887a11830be tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093053 Aug 11 10:02:13.451511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 175/346] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:02:13 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:14.332968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:14.333983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:14.337161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=14 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:14.341550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:14.342040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:14.342588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:14.343397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:14.343888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:14.344325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:14.483241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:14.491889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1a3ba5d1-18c4-4c27-ac1b-d8a1f43d3bfc tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.163754 Aug 11 10:02:14.492772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 172/347] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:14 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:14.681625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40073569-0bde-4157-8824-48a436788df4", "tag": "85a49c50-fe6c-4093-9187-765871b4466f"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:14.691297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:14.691769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:14.692195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:14.705661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] Creating event network-changed:85a49c50-fe6c-4093-9187-765871b4466f for instance 40073569-0bde-4157-8824-48a436788df4 on hv-cinder-81566 Aug 11 10:02:14.710599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-30520d6e-9975-4534-aaf8-542c6d73d8de req-ba33ec27-1b70-4d95-abd8-10cc4a9009ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Aug 11 10:02:14.711358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 176/348] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:15.513379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:15.514072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:15.520957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:15.521489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:15.522296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:15.523147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:15.523759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:15.524344 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:15.674244 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:15.681679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-03525c46-72a4-4a65-ba37-ec823785dcb0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.172087 Aug 11 10:02:15.682245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 173/349] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:15 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:16.703246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:16.703970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:16.710438 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:16.710995 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:16.714946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:16.714946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:16.714946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:16.714946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:16.717748 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:16.847947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:16.855530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-42cfbaff-f773-4937-adf9-bcb7c345f5e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.157028 Aug 11 10:02:16.856188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 177/350] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:16 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:17.877219 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:17.877847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:17.884324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:17.884804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:17.885267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:17.885961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:17.886398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:17.886813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:18.019410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:18.026889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3f97aa06-60e3-4a61-a8e6-dc705039aa8f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.154407 Aug 11 10:02:18.027414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 174/351] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:17 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:19.029905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc825882-520d-43ba-bfbb-86039a4e2236", "name": "network-vif-plugged", "status": "completed", "tag": "a9c76001-b3fb-484d-ac4d-9ea310b35ca4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:19.040518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:19.042717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:19.042717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:19.048636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:19.049362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:19.054348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] Creating event network-vif-plugged:a9c76001-b3fb-484d-ac4d-9ea310b35ca4 for instance fc825882-520d-43ba-bfbb-86039a4e2236 on hv-cinder-81566 Aug 11 10:02:19.055614 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:19.056096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:19.056525 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:19.057381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:19.057863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:19.058293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:19.059431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-93df772f-74bb-4a14-a329-4b129ddf5342 req-99ca6ec0-d227-41b4-b13d-58ccefb6db93 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033194 Aug 11 10:02:19.060312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 178/352] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:19.209923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:19.217561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-974fb7e2-b924-4c1b-b80a-9256055b422d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.173679 Aug 11 10:02:19.218154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 175/353] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:19 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:20.239546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:20.240237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:20.246473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:20.246984 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:20.247413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:20.248097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:20.248543 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:20.248960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:20.376432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:20.384120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2eb15635-819e-4772-87ef-febb07c578e7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.149256 Aug 11 10:02:20.392375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 179/354] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:20 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:02:21.404526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:21.405168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:21.412309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:21.412795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:21.413249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:21.413941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:21.414394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:21.414851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:21.549422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:21.557051 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-317df9a9-9be5-4d06-8417-e0f229ff6ba7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.156439 Aug 11 10:02:21.557612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 176/355] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:21 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:22.577060 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:22.578457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:22.584890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:22.585468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:22.585942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:22.588488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:22.588488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:22.588488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:22.727880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:22.736246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-19939f07-bf93-4b04-a0be-5dc539b92c3f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1319 microversion: 2.1 time: 0.163157 Aug 11 10:02:22.736831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 180/356] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:22 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:23.756961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:23.757590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:23.763972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:23.764452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:23.764935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:23.765734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:23.766185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:23.766608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:23.900211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:23.908088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-66c177a4-c515-4bbf-b6ba-60a032f8cd69 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1507 microversion: 2.1 time: 0.154958 Aug 11 10:02:23.908650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 177/357] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:02:23 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:02:39.390474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=63 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:39.391243 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=18 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:39.593278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-67550a5d-579a-41cb-a6e1-474bf9665587 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Action: 'create', calling method: .version_select at 0x7f787c42cd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1138903170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYlsOD9ecMjg9kfrUAy9TdOW8AfhOJ8MTosrIfqplHs7y0JFG0KXt1NrHGzUHDUJY+ODleO6fOjrowD/3BBOaiBKiHd+IE1jNT0hLtuyzIfi44fdxyiKg2aq9GNLxMhsQ=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:39.612943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-67550a5d-579a-41cb-a6e1-474bf9665587 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for project ea7b166d3468425ab368e369b4dd9989. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:02:39.617682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-67550a5d-579a-41cb-a6e1-474bf9665587 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for user ee81d8d9cf994df68a15afe5cb9673c4 and project ea7b166d3468425ab368e369b4dd9989. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:02:39.693679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-67550a5d-579a-41cb-a6e1-474bf9665587 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.313054 Aug 11 10:02:39.695111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 181/358] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:02:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:02:40.602874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:40.603393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:40.605599 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=39 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:40.606266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=72 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:40.611224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:40.611726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:40.612161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:40.612858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:40.613335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:40.613755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:40.637532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ca2edd85-be69-4d38-b4cb-0903aec7668c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/ips" status: 200 len: 152 microversion: 2.20 time: 0.038571 Aug 11 10:02:40.638105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 178/359] 10.222.0.17 () {60 vars in 1289 bytes} [Thu Aug 11 10:02:40 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:02:43.699209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:43.699209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:43.707323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:43.708114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:43.708550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:43.709392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:43.709870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:43.711546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:43.746258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'flavor' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:02:44.237101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-49f1d001-f0d3-4c75-bef9-99e9d62320d2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/action" status: 202 len: 0 microversion: 2.20 time: 0.556998 Aug 11 10:02:44.237987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 182/360] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Aug 11 10:02:43 2022] POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:02:44.246458 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:44.247575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:44.255712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:44.256194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:44.256632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:44.257345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:44.257794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:44.258216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:44.393217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:44.401184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:44.402666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:44.403936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bf32a1d3-af2f-4db0-ab5e-e5f05891426c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.161588 Aug 11 10:02:44.404483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 179/361] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:44 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:44.761897 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fb0b3e-b058-4629-8f69-a5de7f5452d5", "device": "/dev/sdb"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:02:44.764705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:44.771706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:44.772178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:44.772601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:44.773300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:44.773750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:44.774164 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:45.426860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:45.427484 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:45.434419 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:45.434906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:45.435339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:45.436043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:45.436491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:45.436908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:45.541341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-14ec37f8-e22b-465a-8c9a-0bbcb9f7b0f0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "POST /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783714 Aug 11 10:02:45.541662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 183/362] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:02:44 2022] POST /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:02:45.586464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:45.593149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:45.595329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:45.597229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-07e488a2-6b1c-420c-93da-df1fe38cd6cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.174449 Aug 11 10:02:45.597826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 180/363] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:45 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:02:46.621635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:46.622353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:46.628762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:46.629284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:46.629825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:46.630457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:46.632693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:46.633171 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:46.767931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:46.775951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:46.777472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:46.778631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b92ee3e2-93e1-4899-9ac2-27476709a76f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.162036 Aug 11 10:02:46.779214 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 184/364] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:46 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:47.803675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:47.804281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:47.810634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:47.811110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:47.811537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:47.812216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:47.812660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:47.813106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:47.942754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:47.951718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:47.953250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:47.954432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fe047fc4-37be-4ca7-b1c6-8d51c6fab71d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.155576 Aug 11 10:02:47.954983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 181/365] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:47 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:48.980097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:48.980606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:48.987371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:48.988004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:48.988443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:48.989170 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:48.989624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:48.990046 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:49.125390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:49.134538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:49.136029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:49.137222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c6b4e4ea-00dc-4661-a31b-988ee93c007e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.161166 Aug 11 10:02:49.137777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 185/366] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:48 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:50.160294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:50.160839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:50.167171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:50.167655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:50.168087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:50.168777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:50.169270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:50.169702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:50.303812 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:50.311767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:50.313309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:50.314463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b39b0c44-5fa1-47e5-aa16-6b91f30338c4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.158708 Aug 11 10:02:50.315022 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 182/367] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:50 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:51.336934 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:51.337570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:51.339817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=4 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:51.345096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:51.345579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:51.346018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:51.347487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:51.348133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:51.348567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:51.484238 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:51.493324 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:51.495166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:51.496681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8d0b6637-1089-40c2-bd03-41b43283a2d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.163513 Aug 11 10:02:51.497427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 186/368] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:51 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:52.520418 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:52.520958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:52.527445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:52.527939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:52.528364 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:52.529076 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:52.529533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:52.529959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:52.662322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:52.670220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:52.671695 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:52.672826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b7fd21bb-bb95-4766-a773-dbde9d54fd71 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.156871 Aug 11 10:02:52.673400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 183/369] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:52 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:53.696724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:53.697360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:53.703821 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:53.704305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:53.704734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:53.705469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:53.706676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:53.707101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:53.839931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:53.848085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:53.849635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:53.850802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-072570ae-0360-4a1f-8a77-5d6487e299a4 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.158275 Aug 11 10:02:53.851362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 187/370] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:53 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:54.873650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:54.874248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:54.880631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:54.881141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:54.881566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:54.882253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:54.882699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:54.883113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:55.019714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:55.027462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:55.028940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:55.030102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-056a7035-28c8-4d80-8348-fabcd4c81747 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.160433 Aug 11 10:02:55.030644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 184/371] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:54 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:56.053911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:56.054513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:56.062647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:56.063187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:56.063615 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:56.064549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:56.065075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:56.066377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:56.208540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:56.217043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:56.218636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:56.219823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-73a1c874-b043-4ac4-b039-e2d691b87650 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.169791 Aug 11 10:02:56.220435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 188/372] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:56 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:57.242072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:57.242675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:57.249072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:57.249551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:57.249981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:57.250669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:57.251144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:57.251569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:57.384242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:57.392210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:57.394363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:57.395513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-118dc07d-d8d0-4e2c-b625-53e0b040653a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.157358 Aug 11 10:02:57.396071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 185/373] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:57 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:58.418464 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:58.419069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:58.426409 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:58.426892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:58.427318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:58.428003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:58.428461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:58.428880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:58.564733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:58.572543 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:58.574053 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:58.575190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6dbd5cce-c0c8-4f5c-bcbb-8292d3ffc714 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.160805 Aug 11 10:02:58.575736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 189/374] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:58 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:02:59.597746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:02:59.598369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:02:59.604150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:59.604626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:59.605077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:59.605772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:02:59.606213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:02:59.606633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:02:59.739271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:59.751310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:59.752940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:02:59.755290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b525a8b3-f3ad-4588-9eb5-58e4760f96fd tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.161161 Aug 11 10:02:59.756164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 186/375] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:02:59 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:00.778965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:00.779717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:00.786788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:00.787268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:00.787700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:00.788391 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:00.788844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:00.789295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:01.115277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:01.123124 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:01.124627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:01.125812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ca44e165-c1c4-47da-894c-69e6fb476be9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.350727 Aug 11 10:03:01.126376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 190/376] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:00 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:02.149373 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:02.149896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:02.156288 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:02.156760 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:02.157233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:02.157915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:02.158363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:02.158781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:02.286730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:02.294730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:02.296230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:02.297940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-429cd125-bc7c-4fef-9ee3-5e4bc8361750 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.152585 Aug 11 10:03:02.298499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 187/377] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:02 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:03.321264 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:03.321860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:03.328592 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:03.329105 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:03.329544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:03.330220 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:03.330666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:03.331080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:03.466239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:03.474103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:03.475598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:03.476810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4523ee0a-dcb2-43e0-af65-6dfee4435a6b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.159421 Aug 11 10:03:03.477347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 191/378] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:03 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:03.485269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:03.485771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:03.492520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:03.492996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:03.493455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:03.494256 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:03.494711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:03.495131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:03.620416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lazy-loading 'services' on Instance uuid e982719f-0cc3-44b1-aebb-f7832a9e7440 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:03.849929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ea353e37-d043-4b3d-87a6-583ab8fdd5f1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments/3ad355a0-531e-470e-8555-68589f87688a" status: 202 len: 0 microversion: 2.1 time: 0.368630 Aug 11 10:03:03.850505 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 188/379] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:03:03 2022] DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments/3ad355a0-531e-470e-8555-68589f87688a => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:03:04.499768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:04.501573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:04.507434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:04.507916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:04.508341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:04.509044 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:04.509498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:04.509916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:04.646475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:04.654373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:04.655933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:04.657133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e61377c7-745c-410b-ad40-b00bcb09770a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.161362 Aug 11 10:03:04.657699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 192/380] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:04 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:05.193777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-997740145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1138903170", "security_groups": [{"name": "tempest-secgroup-smoke-671395048"}], "block_device_mapping_v2": [{"uuid": "a528f449-f9bc-432d-9096-7a9649d5062b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43181ee7-31a3-4e3c-b3f4-f4da182a8730"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:05.305808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] validate_networks() for [('43181ee7-31a3-4e3c-b3f4-f4da182a8730', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:03:05.674107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:03:05.674525 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:03:05.674990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:03:05.675399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:03:05.675859 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:03:05.681428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:05.682032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:05.685469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:05.685958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:05.686421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:05.687153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:05.687604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:05.688089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:05.694496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:05.694870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:05.695528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:05.696101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:05.696633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:05.697257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:05.705648 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:03:05.710825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for user ee81d8d9cf994df68a15afe5cb9673c4 and project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:03:05.770804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:03:05.772983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a528f449-f9bc-432d-9096-7a9649d5062b',volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:03:05.831213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:05.840444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:05.841952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:05.843142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b3ea5fba-2cd1-497c-9e21-0e77333e577e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.165556 Aug 11 10:03:05.843690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 193/381] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:05 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:06.145854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3c0d5e88-3eb1-4384-955a-6a304502eb20 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.957604 Aug 11 10:03:06.146685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 189/382] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:03:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:03:06.157827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6f5805a7-faa1-4466-9912-7b37ce38bd2a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:06.158406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6f5805a7-faa1-4466-9912-7b37ce38bd2a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:06.215033 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6f5805a7-faa1-4466-9912-7b37ce38bd2a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:06.221843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6f5805a7-faa1-4466-9912-7b37ce38bd2a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1094 microversion: 2.1 time: 0.067795 Aug 11 10:03:06.222470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 194/383] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:06 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:06.496691 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdbc952a-7052-4e68-8d09-0733c0ec5176"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:06.499270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:06.505491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:06.505968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:06.509857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:06.509857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:06.509857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:06.509857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:06.866217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:06.866817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:06.873136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:06.873619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:06.874056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:06.874745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:06.875202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:06.875621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:07.009122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:07.016968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:07.018484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:07.020310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7a92ac8e-70ed-4c7c-845b-81c7567a409c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.158053 Aug 11 10:03:07.020997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 195/384] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:06 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:07.242223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:07.242817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:07.248733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:07.249239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:07.249664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:07.250332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:07.250780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:07.251191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:07.255633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:07.314610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:07.322290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a22a4a48-5056-4c8d-9213-9d6e8bd3d04e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1144 microversion: 2.1 time: 0.083933 Aug 11 10:03:07.322931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 196/385] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:07 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:08.044309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:08.044892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:08.052179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.052667 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.053116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.053841 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.054292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.054735 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.214509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:08.223011 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:08.225135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:08.226364 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8ceb5432-889c-4c9e-a534-6347972eee8a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.186443 Aug 11 10:03:08.226865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 197/386] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:08 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:08.312873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:08.318992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.319467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.319900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.342453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Going to try to stop instance {{(pid=121197) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 10:03:08.483857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b49c3fad-aa06-4846-a208-d02eb1b04edd tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.991346 Aug 11 10:03:08.484397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 190/387] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:03:06 2022] POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 194 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:08.493362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:08.494134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:08.503032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.503514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.503939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.505555 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.505936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.506357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.564645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bac03315-7fe6-4429-80be-d9feaad4bce4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action" status: 202 len: 0 microversion: 2.1 time: 0.255400 Aug 11 10:03:08.570084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 198/388] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:03:08 2022] POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 10:03:08.582629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:08.583825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:08.583966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:08.591505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.591987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.592609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.593399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:08.593848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:08.602246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:08.602375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7916c71d-bd2c-4d37-a501-c8f448605d29 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1136 microversion: 2.1 time: 0.108008 Aug 11 10:03:08.602375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 191/389] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:08 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1136 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:08.734300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:08.743216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-387c7793-46df-4aaa-a092-64b68caa7517 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.169711 Aug 11 10:03:08.743991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 199/390] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:08 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:09.249381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:09.249977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:09.257289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.257698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.258126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.258802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.259247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.259663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.385574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:09.393509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:09.395119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:09.396965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f41179fd-998d-43b7-b0a0-faff16807690 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1745 microversion: 2.20 time: 0.151408 Aug 11 10:03:09.397576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 192/391] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:09 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:09.621425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:09.622038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:09.624420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:09.629175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.630266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.630820 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.631512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.631967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.632395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.699258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:09.706837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cacde50c-4083-416e-81f0-f698d005ebc5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1192 microversion: 2.1 time: 0.089339 Aug 11 10:03:09.707403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 200/392] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:09 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:09.766088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:09.766728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:09.773103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.773592 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.774097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.774807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:09.775254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:09.775671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:09.795516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:09.916397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:09.923896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-51c3ae86-ff4e-487b-8bd7-7e88e0f604ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.161788 Aug 11 10:03:09.924449 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 193/393] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:09 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:10.420460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:10.421073 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:10.427355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.427820 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.428278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:10.429021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.429479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.429893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:10.555929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:10.563738 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:10.565281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:10.566432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-57fa98f9-c110-4041-95a7-dba2257a328e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1745 microversion: 2.20 time: 0.150222 Aug 11 10:03:10.567019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 201/394] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:10 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:10.728266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:10.728869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:10.735352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.735827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.736250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:10.736920 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.737413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.737826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:10.803857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:10.811239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-da974ae2-23bd-4979-b08f-542c6e1da0e0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1192 microversion: 2.1 time: 0.086787 Aug 11 10:03:10.811793 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 194/395] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:10 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:10.944836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:10.945551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:10.951889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.952365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.952786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:10.953484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:10.953929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:10.954342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:11.081528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:11.089569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a6f5d84f-6982-4f0b-ae20-38a3cf78665f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.149141 Aug 11 10:03:11.090389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 202/396] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:10 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:11.589398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:11.590249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:11.596085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:11.596564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:11.596991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:11.597682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:11.598621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:11.599036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:11.728569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:11.736614 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:11.738121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:11.740290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a06a2950-bd31-4b1c-afd2-935dde2571cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1745 microversion: 2.20 time: 0.154700 Aug 11 10:03:11.740842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 195/397] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:11 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:11.833406 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:11.833938 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:11.840191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:11.840761 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:11.841221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:11.841912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:11.842360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:11.842780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:11.907041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:11.915021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-359667cd-c3cd-4b44-b008-9daa956b856e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1192 microversion: 2.1 time: 0.085858 Aug 11 10:03:11.915595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 203/398] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:11 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:12.110243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:12.110775 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:12.116829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.117342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.117773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:12.118453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.118905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.119327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:12.246643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:12.254194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-236b3fd0-90ef-467c-bd67-beb3debf04f8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.147820 Aug 11 10:03:12.255382 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 196/399] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:12 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:12.763549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:12.764203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:12.771321 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.771859 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.772491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:12.773278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.773726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.774141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:12.908641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:12.917480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:12.919861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:12.921323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ce468810-03cb-4fe9-8dd3-78d2f40946c1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1745 microversion: 2.20 time: 0.161595 Aug 11 10:03:12.921893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 204/400] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:12 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:12.935789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:12.936424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:12.943657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.944140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.944568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:12.945708 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:12.946299 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:12.946753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:13.025068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:13.033450 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-94fe4470-b8a3-4c64-9d97-214a710fa789 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1200 microversion: 2.1 time: 0.101605 Aug 11 10:03:13.034816 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 197/401] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:12 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:13.275822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:13.276536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:13.284201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:13.284769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:13.285302 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:13.286603 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:13.287124 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:13.287967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:13.443811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:13.453316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-30eeb521-55ff-40a6-90ef-641cb2d876ea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.181409 Aug 11 10:03:13.457213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 205/402] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:13 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:13.945695 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:13.946999 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:13.954931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:13.955725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:13.956337 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:13.957513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:13.958756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:13.959547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.007191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "name": "network-vif-plugged", "status": "completed", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:14.026857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:14.026857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:14.026857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.040134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] Creating event network-vif-plugged:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:03:14.046189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-be816dbf-4a3b-4e99-ad5b-a6a8740eec78 req-a767d330-e447-48eb-971f-1e4fd75e8665 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044870 Aug 11 10:03:14.050692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 206/403] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:14.081895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:14.081895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:14.086668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:14.088189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:14.088886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.096576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:14.097193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:14.097912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.309678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:14.323774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:14.325292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:14.326549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ed1fddaf-e8e8-4ede-adde-b4400c15bf5d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.385448 Aug 11 10:03:14.328573 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 198/404] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:13 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:14.358518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:14.371976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d943c8b6-61a7-4811-9b51-9f366bcc48f7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.308127 Aug 11 10:03:14.372819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 207/405] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:14 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:14.475581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:14.476185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:14.479621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:14.490634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:14.491125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:14.491560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.492261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:14.492713 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:14.493530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:14.682681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:14.690931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4d88541f-a861-4d02-9a95-7b2e66012d9a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.220099 Aug 11 10:03:14.691766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 199/406] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:14 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:15.172512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc4d305-287b-4a37-9d4d-99ceb3e3f720", "tag": "13119f6c-980c-4766-a32c-a213e4198421"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:15.172512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.172512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.172512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.173842 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] Creating event network-changed:13119f6c-980c-4766-a32c-a213e4198421 for instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 on hv-cinder-81566 Aug 11 10:03:15.196121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-05b214d6-df51-4d42-a8dc-e7cd8ddf38b9 req-e3d73a32-f334-4fdf-afd0-17ba8388017e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050058 Aug 11 10:03:15.196821 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 208/407] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:15.351874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:15.353324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:15.371078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.373250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.373250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.373250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.374029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.374615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.395323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:15.403816 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:15.414842 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.417695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.419063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.421863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.424985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.427121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.641665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:15.654821 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:15.659185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:15.674876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d212de55-92e4-47c2-b42a-53d2558ae855 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.315101 Aug 11 10:03:15.685907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:15.694775 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 200/408] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:15 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:15.697577 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-34ad997b-13c2-44a0-b045-9aa8ed508516 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.307273 Aug 11 10:03:15.698600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 209/409] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:15 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:15.712017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:15.712625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:15.716128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:15.726641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=6 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:15.728753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.729275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.733771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.733771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:15.733771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:15.733771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:15.891603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:15.903128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a5b2f034-093e-4f8e-9120-39cd63945dcd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.194915 Aug 11 10:03:15.903781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 201/410] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:15 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:16.707995 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:16.708668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:16.711948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:16.717654 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.718216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.718644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:16.719513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.719958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.720381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:16.720559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:16.722971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:16.731644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.732459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.732969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:16.733791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.734703 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.735354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:16.949153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:16.960908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:16.963234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:16.963968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:16.964776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3ad2551f-6aa8-48a3-8ec1-d4802028d757 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.261324 Aug 11 10:03:16.972297 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-04f2228d-c9ef-430f-8ea6-73675f5afd0e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.256180 Aug 11 10:03:16.972899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 202/411] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:16 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:16.979301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:16.979910 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:16.981332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 210/412] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:16 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:16.988521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.988521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.988521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:16.988521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:16.989121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:16.989121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:17.131993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:17.139538 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a43d3932-3050-42a1-bc4b-3f1b75fa58b8 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.165447 Aug 11 10:03:17.140110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 203/413] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:16 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:17.706639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:17.707131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:17.715664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:17.716802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:17.717266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:17.717975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:17.718586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:17.719167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:17.855466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lazy-loading 'services' on Instance uuid fc825882-520d-43ba-bfbb-86039a4e2236 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:17.988851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:17.990616 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:17.997946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.013138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.013138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.013138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.013138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.013526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.124285 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-50fb1e1f-cada-4678-851a-0eea6abfe6d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236/os-volume_attachments/05fb0b3e-b058-4629-8f69-a5de7f5452d5" status: 202 len: 0 microversion: 2.1 time: 0.421313 Aug 11 10:03:18.125335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 211/414] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:03:17 2022] DELETE /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236/os-volume_attachments/05fb0b3e-b058-4629-8f69-a5de7f5452d5 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:03:18.156679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:18.159118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:18.176649 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.177212 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.178474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.179298 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.179865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.180297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.183391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:18.198877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:18.200639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:18.202107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d02a2be6-b4eb-4f4b-b1f9-a6c906209d80 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.217513 Aug 11 10:03:18.204860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 204/415] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:17 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:18.235807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:18.243796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:18.246546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:18.247172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.247839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.248476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.249369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:18.250020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:18.250714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:18.452671 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:18.465281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-90821505-c90e-43d3-8f59-6d9e219f33f9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.334730 Aug 11 10:03:18.466913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 212/416] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:18 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:18.473211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:18.482454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-17369ba8-d856-4d65-9219-0f4cac3499d4 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.276330 Aug 11 10:03:18.483298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 205/417] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:18 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:19.227051 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:19.228265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:19.235966 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.235966 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.236370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.237343 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.238066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.239118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.390482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:19.399435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:19.407057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:19.407057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d747f92b-8870-41f1-929b-ba00caa25f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.180116 Aug 11 10:03:19.407057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 213/418] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:19 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:19.485438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:19.486588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:19.494300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.495015 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.495627 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.496484 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.496930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.497532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.504338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:19.505683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:19.512869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.514202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.514858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.515889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:19.516417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:19.516922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:19.734589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:19.742893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a6014f9a-1c6c-4791-ac83-a86621430a96 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.261248 Aug 11 10:03:19.757340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:19.757960 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 206/419] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:19 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:19.769444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-557f39fe-0d62-4566-9bc0-04241d3bab7a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.266932 Aug 11 10:03:19.775435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:19 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:20.426651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:20.430653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:20.434298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.434777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.435210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:20.435900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.436347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.436783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:20.583603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:20.593159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:20.594383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:20.595537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0d5ab77e-6fd3-4bbc-82dd-a067b49e0a74 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.172750 Aug 11 10:03:20.596366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 207/421] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:20 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:20.768826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:20.770219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:20.778839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.779790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.780680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:20.781924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.782581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.783155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:20.794205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:20.797448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:20.805817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.806433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.806955 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:20.807977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:20.808532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:20.809597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:21.048418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:21.056893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c86bc7ab-8300-4fd5-803e-a30e0e801da3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.291945 Aug 11 10:03:21.057595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 215/422] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:20 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:21.059376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:21.074557 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-65022167-d557-4fae-bf58-aff438b5e534 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.286494 Aug 11 10:03:21.081051 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 208/423] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:20 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:21.577621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:21.580296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:21.587265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:21.587842 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:21.588345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:21.589150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:21.589808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:21.590588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:21.620069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'flavor' on Instance uuid 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:21.623878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:21.624575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:21.640008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:21.641371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:21.641883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:21.646504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:21.646504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:21.646504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:21.816554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:21.825930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:21.827466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:21.831513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-74d2320f-1289-4885-a4d7-deefcbdcd6ac tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.209646 Aug 11 10:03:21.837687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 209/424] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:21 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:21.969609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f8301319-08d3-4601-8f90-5d8ecbcbb96e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/action" status: 200 len: 32 microversion: 2.1 time: 0.395852 Aug 11 10:03:21.971495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 216/425] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:03:21 2022] POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:03:21.982008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:21.982990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:21.992392 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.000077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.000077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.000077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.000077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.000566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.000566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:22.079645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:22.080692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.087968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.088794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.089277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.090420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.090875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.091475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.258506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:22.268661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e4d501a2-fb6b-478d-8282-972f4aac5401 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.291517 Aug 11 10:03:22.281178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 210/426] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:21 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:22.293283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:22.293891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.311349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.314889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.314889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.315756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.316223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.321583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.322123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:22.331207 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b3cd9f2f-6db9-49b3-bfc6-5007a328486b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1277 microversion: 2.1 time: 0.255674 Aug 11 10:03:22.346754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 217/427] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:22 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:22.494903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:22.503190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-81e05d50-9128-4c83-acfc-cbe29c21d788 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.220691 Aug 11 10:03:22.503955 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 211/428] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:22 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:22.605773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:22.606262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.617612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.618110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.618567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.619254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.619722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.620135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.646625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3707036d-a393-4e0e-9e2d-8df191a5edb7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/ips" status: 200 len: 150 microversion: 2.1 time: 0.044482 Aug 11 10:03:22.653717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 218/429] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:03:22 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:22.659575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65078536-835b-4f46-a35b-45bdf1b5998f"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:22.662320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.673424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.674078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.674647 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.675526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.679325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.686427 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.784681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: POST /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/os-volume_attachments HTTP/1.1 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 74 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:03:22.793228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {"volumeAttachment": {"volumeId": "65078536-835b-4f46-a35b-45bdf1b5998f"}} Aug 11 10:03:22.795005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'server_id': '40073569-0bde-4157-8824-48a436788df4', 'body': {'volumeAttachment': {'volumeId': '65078536-835b-4f46-a35b-45bdf1b5998f'}}} Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:22.795917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:22.799239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 400 to user: Invalid volume: volume 65078536-835b-4f46-a35b-45bdf1b5998f is already attached to instances: ddfb9f02-1255-481b-b2df-bd1b4b8f9159 {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-924d45f2-d9d3-48ab-afd6-cba755a4b490 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134150 Aug 11 10:03:22.801237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 212/430] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:03:22 2022] POST /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 10:03:22.804484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:22.805123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.811865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.818535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.818535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.818535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.818535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.818942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.864428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:22.865231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:22.875440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.878283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.878946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.879867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:22.881073 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:22.884417 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:22.913069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:03:23.052231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.063723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.065719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.067088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-435fac0d-5243-4c3f-a1e5-ab44c67b70a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.206964 Aug 11 10:03:23.068280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 213/431] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:22 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:23.323009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:23.324225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:23.366056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.366972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.367606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.370776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.371728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.372390 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.388114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-347422f7-a306-4d85-839a-7186fd4e624f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 204 len: 0 microversion: 2.1 time: 0.590985 Aug 11 10:03:23.389457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 219/432] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:03:22 2022] DELETE /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:03:23.404759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:23.410223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:23.435230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.440425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.453293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.453293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.453293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.457165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.676535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.691870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d0c3884c-253f-4b3e-8177-7edc12809945 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.403773 Aug 11 10:03:23.692449 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 214/433] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:23 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:23.697579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:23.698180 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:23.704161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.704637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.705196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.705961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.706423 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.706842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.727029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.734474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-531c3c20-7876-4e99-a63f-9a8efc95408e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.343477 Aug 11 10:03:23.735047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 220/434] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:23 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:23.745410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:23.746163 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:23.752281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.752840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.753386 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.754072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:23.754517 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:23.754984 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:23.885663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.893855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5fcf4573-841a-42e9-9103-ce1349be1716 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1680 microversion: 2.1 time: 0.200106 Aug 11 10:03:23.894415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 215/435] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:23 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:23.915414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:23.922803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e68f5deb-013d-45f6-8297-ab9fdf97d2ff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.181015 Aug 11 10:03:23.923378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 221/436] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:23 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:24.095636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:24.096414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:24.105164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.105905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.106488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.107345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.107946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.108542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.262991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:24.273655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:24.275454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:24.277824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-13819c3e-0bce-4dc5-9d3f-0871c3951ff1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.188310 Aug 11 10:03:24.278385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 216/437] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:24 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:24.714444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:24.715473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:24.715633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:24.716030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:24.721660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.722134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.722399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.722560 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.722863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.723238 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.723336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.723710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.724001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.724111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.724686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.725232 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.750588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:03:24.854533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:24.862690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9550a36a-1b70-4dcc-a6db-282b9d0b25c6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.152354 Aug 11 10:03:24.863254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 222/438] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:24 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:24.875668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:24.878621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:24.883039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.883721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.884319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:24.885214 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:24.885810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:24.886377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.038373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.046374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5c8e0a55-a975-4176-ab4e-74a16e2bec4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.182176 Aug 11 10:03:25.047046 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 223/439] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:24 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:25.054459 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:25.058747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:25.060842 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.061347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.061769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.062443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.062886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.063300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.102348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d2da7d54-e2cb-4715-9295-2a28d5296711 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 204 len: 0 microversion: 2.1 time: 0.390569 Aug 11 10:03:25.102943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 217/440] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:03:24 2022] DELETE /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:03:25.108754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:25.109489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:25.116041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.116686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.117159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.117866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.118319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.118762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.258197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.265989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4c76dcc3-9895-4eab-8766-e6c1027fa302 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1680 microversion: 2.1 time: 0.215880 Aug 11 10:03:25.266564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 224/441] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:25 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:25.270964 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:25.271797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:25.277962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.281287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.281287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.281287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.281287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.281805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.310327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.318116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-003a4524-7f4c-4bc3-9c7c-fe2c90aed8bb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1677 microversion: 2.1 time: 0.213763 Aug 11 10:03:25.318689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 218/442] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:25 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:25.323346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:25.325823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:25.330635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.331118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.331605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.332306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.332764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.333217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.471507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.475642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:25.480016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9d74a4c7-cc3e-4e6a-8fef-773f23dce877 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1513 microversion: 2.1 time: 0.212517 Aug 11 10:03:25.480620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 225/443] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:25 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:25.500583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.508528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.510042 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:25.511208 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a99250ac-b19e-4c94-9e3b-e6d372bb9f3e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.191455 Aug 11 10:03:25.511767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 219/444] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:25 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:25.886398 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:25.887002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:25.893715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.894193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.894621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:25.895301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:25.895752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:25.896814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.027092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.035079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-be7fced4-598d-4e26-99c1-61d7c3525b6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.152889 Aug 11 10:03:26.035635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 226/445] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:25 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:26.067462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.068589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.075123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.075596 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.076024 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.076698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.077210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.077626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.207020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.214336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-054310aa-808c-423b-9ec2-a86a05146a56 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.150668 Aug 11 10:03:26.214888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 220/446] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:26.288849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.289484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.295310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.295790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.296216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.296895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.297365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.297786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.339438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.340331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.346181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.346660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.347093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.347811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.348221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.348737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.470853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.478912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6de27088-df56-4299-934a-ccfa36f83a8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1680 microversion: 2.1 time: 0.194039 Aug 11 10:03:26.479475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 227/447] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:26.501453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.502082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.507139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.508308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.508791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.509268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.509940 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.510388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.510806 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.514572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9f0bbf02-1dee-4c23-9c7e-fca5c15d24ae tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1654 microversion: 2.1 time: 0.179008 Aug 11 10:03:26.515326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 221/448] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1654 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:26.535180 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.535944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.542873 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.543356 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.543786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.544471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.544919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.545357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.699287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.706636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b45187f4-32d3-4f3a-bd9d-9dee49fd45d5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1513 microversion: 2.1 time: 0.209019 Aug 11 10:03:26.707196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 228/449] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:26.711849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:26.717883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.718363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.718790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.721599 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.731964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.733946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:26.735114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-339c78f2-78f8-44d2-a2d6-372f46723ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1740 microversion: 2.20 time: 0.204509 Aug 11 10:03:26.735704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 222/450] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:26.747039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Going to try to start instance {{(pid=121197) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 10:03:26.887829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6f743848-a700-4245-8abc-6a2f551c4e19 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action" status: 202 len: 0 microversion: 2.1 time: 0.179440 Aug 11 10:03:26.888523 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 229/451] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:03:26 2022] POST /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:03:26.897482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:26.898088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:26.904077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.904551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.905045 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:26.905742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:26.906199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:26.906622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.035026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:27.043378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc2c2e40-a7e1-42d6-a5d0-8483700ab567 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1663 microversion: 2.1 time: 0.150853 Aug 11 10:03:27.043940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 223/452] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:26 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:27.056247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:27.056931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:27.063415 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.063889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.064321 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.064987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.065455 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.065868 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.199322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:27.207641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3564a703-8328-4289-befa-e36330b5c71c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.155701 Aug 11 10:03:27.213308 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 230/453] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:27 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:27.234589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:27.235277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:27.241850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.242854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.242854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.243495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.243949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.244371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.382303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:27.389931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-131d25eb-aef0-4034-8016-1407d4d57650 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.159238 Aug 11 10:03:27.390748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 224/454] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:27 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:27.502284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:27.506732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:27.509979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.510541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.511047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.511799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.512312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.512818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.646906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:27.655111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0ee42727-f10c-428a-8d9d-6d640fa86d80 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1680 microversion: 2.1 time: 0.156790 Aug 11 10:03:27.655688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 231/455] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:27 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:27.728196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:27.728917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:27.735273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.735755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.736186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.736876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.737510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.737959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.742840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:27.759374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:27.760289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:27.769493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.770223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.776360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:27.777364 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:27.777977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:27.778551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.453489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.461388 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7324a88c-5c45-46a3-a639-de1d94d5aa2e tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1513 microversion: 2.1 time: 0.737143 Aug 11 10:03:28.470316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 225/456] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:27 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1513 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:28.486966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:28.487728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:28.488037 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.499963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.501491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.504170 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5c055ebf-9b60-4a07-b52d-f771b5ce1b05 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1722 microversion: 2.20 time: 0.747667 Aug 11 10:03:28.504483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.505294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.507468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.508287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.508425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 232/457] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:27 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1722 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:28.510148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.510836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.517715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "name": "network-vif-unplugged", "status": "completed", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:28.542797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.543284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.543705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.557393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] Creating event network-vif-unplugged:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:03:28.563659 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-f4d288d7-ffa5-4f52-9f33-4b368876f1f1 req-cbb9aeaf-958c-41b3-9547-87075b336e3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054045 Aug 11 10:03:28.565097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 233/458] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:28.571132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:28.571988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:28.578880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.579690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.580309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.581222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.581818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.582394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.911080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.923560 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c2ab0d7b-0a35-4dde-b9c6-8c8ec5502d81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.356893 Aug 11 10:03:28.925102 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 234/459] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:28 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:28.932372 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:28.933363 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:28.939018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:28.945348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.946152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.947166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.947550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-22405e8c-0f2a-4735-b6c1-7d17f74c1c9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1663 microversion: 2.1 time: 0.478552 Aug 11 10:03:28.948134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 226/460] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:28 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1663 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:28.948535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.949237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.950834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:28.960209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40073569-0bde-4157-8824-48a436788df4", "name": "network-vif-deleted", "tag": "85a49c50-fe6c-4093-9187-765871b4466f"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:28.986759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:28.987930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:28.987930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.002270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] Creating event network-vif-deleted:85a49c50-fe6c-4093-9187-765871b4466f for instance 40073569-0bde-4157-8824-48a436788df4 on hv-cinder-81566 Aug 11 10:03:29.008767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-eedbcc0a-9e53-45da-b9af-ed58ddd380ec req-39572067-f5e2-4e88-beb1-3203bcf9490f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059351 Aug 11 10:03:29.009585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 227/461] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:29.016106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:29.017318 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:29.024230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.024945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.025584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.026451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.027324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.027932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.140090 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.160636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c1daada7-bc7d-4313-8850-f14ca47ccdcd tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 200 len: 1613 microversion: 2.1 time: 0.148449 Aug 11 10:03:29.161686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 228/462] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:29 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:29.239115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.248572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d7929ae4-28c3-4859-909d-f2d062e71905 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.321361 Aug 11 10:03:29.249181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 235/463] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:28 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:29.457237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc825882-520d-43ba-bfbb-86039a4e2236", "name": "network-vif-deleted", "tag": "a9c76001-b3fb-484d-ac4d-9ea310b35ca4"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:29.471847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.472342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.472765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.483076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:29.483679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:29.489642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] Creating event network-vif-deleted:a9c76001-b3fb-484d-ac4d-9ea310b35ca4 for instance fc825882-520d-43ba-bfbb-86039a4e2236 on hv-cinder-81566 Aug 11 10:03:29.495164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-1d774bdb-4df7-4170-ab26-31ea0adea958 req-bd235aa3-a9f4-4277-8481-d123cca78033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042500 Aug 11 10:03:29.495764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 229/464] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:29.497909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.498486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.498918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.500296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.500763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.501214 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.532312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:29.536258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:29.558756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.559501 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.560102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.561546 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.562258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.568584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.692468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.707829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6612dace-5eb5-4c5c-ba63-34262ced498b tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1471 microversion: 2.1 time: 0.227397 Aug 11 10:03:29.726622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 236/465] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:29 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:29.924722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.935781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.938193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:29.939833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d4f475f5-b760-4c7c-8527-00100b59d3a2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1722 microversion: 2.20 time: 0.411870 Aug 11 10:03:29.941846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 230/466] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:29 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:29.947601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:29.947722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:29.958681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.959393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.960174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.961076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.979188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.980002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:29.984033 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:29.984969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:29.997999 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:29.998827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:29.999362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.001058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.003069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.004179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.366813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:30.370862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:30.374806 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2784f9f5-a296-4736-a621-e08de9da6d0b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.432239 Aug 11 10:03:30.375374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 237/467] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:29 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:30.378318 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d417a7c1-df60-4172-afb5-ab181eba7c8f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1663 microversion: 2.1 time: 0.407961 Aug 11 10:03:30.378879 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 231/468] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:29 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1663 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:30.384280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:30.384883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:30.390480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:30.390664 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.391157 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.391503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:30.391627 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.392275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.392778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.393348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.398908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.399396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.399831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.400520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.400975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.401434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.415820 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 HTTP/1.1 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:03:30.417479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:03:30.419024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '40073569-0bde-4157-8824-48a436788df4'} Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:03:30.419780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:03:30.421217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:03:30.422662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:03:30.422662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-22978e4b-680d-421a-a3cb-ea9f2d73d6ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 404 len: 111 microversion: 2.1 time: 0.034515 Aug 11 10:03:30.422662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 238/469] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:30 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:03:30.427749 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-dd6223ee-d5e2-4865-b2e4-c8643a576cab tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '.version_select at 0x7f787c209310>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:30.526506 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-dd6223ee-d5e2-4865-b2e4-c8643a576cab tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540801225" status: 202 len: 0 microversion: 2.1 time: 0.102408 Aug 11 10:03:30.531485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 239/470] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Aug 11 10:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540801225 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 10:03:30.545303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:30.557455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1a68600b-4c1f-4445-b2bf-54c4e6123e88 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.177480 Aug 11 10:03:30.558312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 232/471] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:30 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:30.732976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:30.733712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:30.740746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.741255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.741867 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.742554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.743000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.743416 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.780697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.781424 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.782003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.782982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lazy-loading 'fault' on Instance uuid fc825882-520d-43ba-bfbb-86039a4e2236 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:30.840260 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:30.851003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4f517249-0e98-4ffa-82fc-b721b7defb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1309 microversion: 2.1 time: 0.121924 Aug 11 10:03:30.851575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 240/472] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:30 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:30.964315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:30.964921 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:30.971550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.972044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.972510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:30.973266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:30.973723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:30.974886 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.107463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.115651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.117186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.118372 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cc38d0d3-00d4-445c-836f-ca88a7042d69 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1722 microversion: 2.20 time: 0.158010 Aug 11 10:03:31.118934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 233/473] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:30 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:31.338154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.338643 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.345298 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.345778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.346210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.346887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.347381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.347801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.396099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.396761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.402829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.403319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.403756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.404482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.404941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.405391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.429981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'services' on Instance uuid ddfb9f02-1255-481b-b2df-bd1b4b8f9159 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:31.543453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.551347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9348b5e9-4633-455f-a3d6-ce76dcd9b4d9 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.159390 Aug 11 10:03:31.552076 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 234/474] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:31 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:31.557125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.557721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.565820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.566566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.566993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.567685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.568724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.569123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.650340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d34c97fc-c09e-4f97-b97b-2c4ea07bbf0f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments/65078536-835b-4f46-a35b-45bdf1b5998f" status: 202 len: 0 microversion: 2.1 time: 0.316666 Aug 11 10:03:31.654112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 241/475] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:03:31 2022] DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments/65078536-835b-4f46-a35b-45bdf1b5998f => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:03:31.655928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.656625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.663535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.664023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.664454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.665186 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.665640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.666068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.705628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.713281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-36acda7c-a914-40e7-8965-a985e45e5be7 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1663 microversion: 2.1 time: 0.159498 Aug 11 10:03:31.713860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 235/476] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:31 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:31.718826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.721302 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.728731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.729347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.729858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.730624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.731157 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.731657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.762692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b447e803-1e31-4a66-8e09-24d8ec3798ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Aug 11 10:03:31.763260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 236/477] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:31 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:31.805740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.809334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:31.813679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3dc9bb29-7b0e-477a-ae2a-61f353e0ab3f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.161649 Aug 11 10:03:31.814271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 242/478] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:31 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:31.876269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:31.876877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:31.883452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.883932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.884367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.885073 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.885527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.885947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.915656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:31.916133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:31.916602 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:31.917071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lazy-loading 'fault' on Instance uuid fc825882-520d-43ba-bfbb-86039a4e2236 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:31.964899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:31.972596 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-aed5d4cf-08f5-4b3a-859e-f53cbe5f9ff2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 200 len: 1309 microversion: 2.1 time: 0.100154 Aug 11 10:03:31.973179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 237/479] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:31 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:32.133129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc4d305-287b-4a37-9d4d-99ceb3e3f720", "name": "network-vif-plugged", "status": "completed", "tag": "13119f6c-980c-4766-a32c-a213e4198421"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:32.142315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.142986 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:32.143225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.143728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.144153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.149221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.150658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.151582 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.152306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.152761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.153225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.155403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] Creating event network-vif-plugged:13119f6c-980c-4766-a32c-a213e4198421 for instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 on hv-cinder-81566 Aug 11 10:03:32.164056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-cdb504f4-fb36-4bc8-bfd0-9d5d6bdb830a req-d75bf619-f8b9-411a-afd2-6c9eca9ac815 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Aug 11 10:03:32.164666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 243/480] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:32.313172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:32.322600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:32.324109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:32.325340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b933aa50-50a2-469d-a08f-f6c7ffad3071 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1722 microversion: 2.20 time: 0.187286 Aug 11 10:03:32.325913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 238/481] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:32.575301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.575986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:32.582708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.585368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.585368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.585368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.585368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.585743 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.718103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:32.726497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4d20204c-d907-494e-9fff-38a6933b9d29 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.157072 Aug 11 10:03:32.727058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 244/482] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:32.734855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.735466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:32.743379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.743918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.744353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.745221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.745699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.746125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.776567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.778833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:32.780938 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:32.786396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.787552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.787987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.788674 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.789193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.789616 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.820527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-45ca6333-ac98-4f07-8f77-64eb0b9b4ca0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049302 Aug 11 10:03:32.821457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 245/483] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:03:32.843473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.844075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:32.852385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.853144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.853722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.854634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:32.855084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:32.855585 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:32.889002 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:32.898156 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-240152f2-9ba1-4f01-bce7-b549491bbe66 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1667 microversion: 2.1 time: 0.167019 Aug 11 10:03:32.898972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 239/484] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:32.994619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:32.995281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: fc825882-520d-43ba-bfbb-86039a4e2236] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:33.000985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:33.001191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.001614 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.002089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.002740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.003181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.003603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.010088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0ae2ffe3-ab5f-4798-8c0b-3332ce14cbde tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.173346 Aug 11 10:03:33.010776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 246/485] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:33.025463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] HTTP exception thrown: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Request method failure captured: Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 HTTP/1.1 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NOXtIl1FP1heNnr6pqduiFJ142fY2mDFENhq1JtxgUZyQ2fkjJXugw7nvNNwxazjNmFcjraF6-drZPpCjyHQMC2I9gggO-WYYy2QXBcpb28iSiRKP3wxn3UF91hmftpusQcx23Wz_PMPclBX0skz9RqnA0coUEzBmRwo3q3Z96GMvM Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: dd2a37c402a64171aae8a8c90b89ce33 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:03:33.027110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: dd2a37c402a64171aae8a8c90b89ce33 Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesSnapshotTestJSON-1710756576-project Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: acd4018e26564721a8c16db0e9d2e0aa Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesSnapshotTestJSON-1710756576-project Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. Aug 11 10:03:33.028710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'fc825882-520d-43ba-bfbb-86039a4e2236'} Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:03:33.033977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. Aug 11 10:03:33.035317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:03:33.037103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Returning 404 to user: Instance fc825882-520d-43ba-bfbb-86039a4e2236 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:03:33.037103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a1ceec86-9e56-4dd5-be2c-b164e085f8a2 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236" status: 404 len: 111 microversion: 2.1 time: 0.038566 Aug 11 10:03:33.037103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 240/486] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:32 2022] GET /compute/v2.1/servers/fc825882-520d-43ba-bfbb-86039a4e2236 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:03:33.349305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:33.349906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:33.355911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.356385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.356813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.357524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.357972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.358389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.493772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:33.501858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:33.503350 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:33.504503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f014855a-a629-4ed8-9a8d-f149ae01569a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1725 microversion: 2.20 time: 0.159151 Aug 11 10:03:33.505142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 247/487] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:33 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:33.528334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b69d2d1-c520-4f9c-bf61-b8578576d575"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:33.530909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:33.536852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.537354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.537782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.538496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.538939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.539383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.748257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:33.748860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:33.755576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.756064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.756495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.757214 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.757663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.758080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.893624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:33.902330 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1e02d54a-197f-4128-97a1-221edbf3786f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.157949 Aug 11 10:03:33.902880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 248/488] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:33 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:33.907541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:33.909736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:33.916270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.916752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.917378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.918478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:33.918478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:33.918883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:33.949241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd47f87f-926e-4ad6-8da9-6479e8a689f3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Aug 11 10:03:33.949790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 249/489] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:33 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:34.030277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:34.030877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:34.036700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.037219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.037652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.038333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.038779 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.039199 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.105225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:34.174398 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:34.181999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c0f383e2-6303-406a-b6ae-6bffa785a07b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.155401 Aug 11 10:03:34.182511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 250/490] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:34 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:34.450021 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3c6e51bd-8b29-4aa2-bd09-075608225959 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.925718 Aug 11 10:03:34.450662 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 241/491] 10.222.0.17 () {62 vars in 1364 bytes} [Thu Aug 11 10:03:33 2022] POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 188 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:03:34.573913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:34.574501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:34.580388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.580862 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.581327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.582001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.582448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.582864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.629187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121197) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 10:03:34.891725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fe39806f-2241-43dd-b3de-2a910c8d90bb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/action" status: 202 len: 0 microversion: 2.20 time: 0.321718 Aug 11 10:03:34.895757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 251/492] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Aug 11 10:03:34 2022] POST /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:03:34.900967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:34.901722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:34.908370 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.908696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.909175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.909863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.910310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.910790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.924926 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:34.925834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:34.932597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.933198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.933729 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:34.934491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:34.935017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:34.935550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:35.111855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:35.123498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:35.127173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:35.129097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:35.131143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-188ef7f5-e257-41ae-a75c-c94cabe0e23f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1751 microversion: 2.20 time: 0.233636 Aug 11 10:03:35.131724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 242/493] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:34 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:35.136665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:35.138913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:35.145132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:35.145587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:35.146063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:35.146798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:35.147416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:35.147830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:35.151488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b699030d-a2ec-43d0-8ef5-27169ecbe16c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.231205 Aug 11 10:03:35.152354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 252/494] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:34 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:35.177794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5e4122fe-5aa1-466a-b897-9c47cd676bb8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 11 10:03:35.178547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 243/495] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:35 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:35.208159 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:35.209153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:35.217086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:35.217568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:35.218086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:35.218800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:35.219327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:35.219651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:35.352444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:35.360436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9ae5ce61-f855-49d3-b097-0e8ff27b8cba tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.158102 Aug 11 10:03:35.361032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 253/496] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:35 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:36.157226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:36.158325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:36.165792 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.166282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.166718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.167527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.167983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.168456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.172021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:36.172648 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:36.179423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.179907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.180333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.181513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.181968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.182395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.373274 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:36.383466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:36.384561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:36.385434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:36.386727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a6f3e55c-e7d1-443a-8164-12b936ac0d35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1751 microversion: 2.20 time: 0.234555 Aug 11 10:03:36.387401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 244/497] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:36 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:36.392851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a4fbae2d-76ab-4610-9957-8fe7f38fe9b1 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.224620 Aug 11 10:03:36.393692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:36.394050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 254/498] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:36 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:36.399151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:36.400027 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:36.400789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:36.403178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:36.404839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.405421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.405931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.406702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.407262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.407766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.410617 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.411334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.413197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.413917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:36.414375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:36.414829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:36.439329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a52ed246-9d63-4586-9455-76f1cbdfe57e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050456 Aug 11 10:03:36.439905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 245/499] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:36 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:36.563800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:36.572074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-511a20c5-8c5c-4662-b7f4-3dc8b2caab47 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1265 microversion: 2.1 time: 0.176897 Aug 11 10:03:36.572629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 255/500] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:36 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:37.411093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.412750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.419012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.419620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.423778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.423778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.423778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.423778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.424169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.424169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.426191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.426672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.427218 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.427960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.428633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.429092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.626367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:37.637041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:37.637200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:37.637770 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:37.638328 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bd0d4bde-a200-407d-9c4d-d3670c00cecc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1753 microversion: 2.20 time: 0.231659 Aug 11 10:03:37.638897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 246/501] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:37 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:37.643640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.646694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.650912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a709554e-ded0-4a56-98ec-f4d580cf8a27 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.236084 Aug 11 10:03:37.652863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 256/502] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:37 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:37.653044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.653044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.653448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.654306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.654927 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.655350 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.658336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.660203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.666742 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.667691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.668485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.669711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.670490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.671460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.707229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9ef0534c-6bdf-4338-aab8-7b70c26ca939 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063312 Aug 11 10:03:37.709420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 247/503] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:03:37 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:03:37.778129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.779746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.788123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.788627 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.789197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.790215 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.790589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.791107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.821351 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:03:37.851487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:37.859983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-35a9b075-ee7a-4fea-b8e8-0464115ab6a2 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1452 microversion: 2.1 time: 0.207453 Aug 11 10:03:37.860633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 257/504] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:37 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:37.892181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:37.892807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:37.899910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.900387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.900810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:37.901520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:37.901967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:37.902381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.039562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.047621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ebe5077c-00a4-4170-9f6b-c185e8fbafe6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1452 microversion: 2.1 time: 0.159690 Aug 11 10:03:38.048189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 258/505] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:37 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:38.118601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-34a79c43-843e-4aab-ab32-d798dd66b3e8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 204 len: 0 microversion: 2.1 time: 0.344052 Aug 11 10:03:38.119184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 248/506] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:03:37 2022] DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:03:38.127454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:38.128057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:38.135234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.135756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.136186 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.136869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.137346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.137770 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.141808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:38.274328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.281882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-196ca836-272b-4637-9c26-8b73a37fdb2c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1682 microversion: 2.1 time: 0.158285 Aug 11 10:03:38.282442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 259/507] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:38 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:38.662934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:38.663882 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:38.670847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.671339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.671948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.672819 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.673335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.673959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.675596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:38.676385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:38.695645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.696373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.696800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.698756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:38.699394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:38.699887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:38.892291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.896346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.904714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a8df7064-9f12-4ce9-a697-fef9c9fd8dee tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.234088 Aug 11 10:03:38.905041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.905727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 260/508] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:38 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:38.917151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:38.917151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bafa8b44-fcb0-4097-bc8a-cc2fd23215da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1753 microversion: 2.20 time: 0.250561 Aug 11 10:03:38.922577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 249/509] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:38 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1753 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:39.303668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:39.307666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:39.313107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.313107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.313107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:39.313107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.313529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.313529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:39.445941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:39.453576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-146e9a7f-6e51-4bde-9ff8-a053723478ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1682 microversion: 2.1 time: 0.154768 Aug 11 10:03:39.454253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 261/510] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:39 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:39.930828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:39.931726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:39.933916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:39.934689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:39.940853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.940853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.940853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:39.940853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.941218 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.941218 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:39.941402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.941645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.942140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:39.943570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:39.944061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:39.944485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:40.371985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:40.381050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:40.381531 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-acbe947b-2e45-4d6e-991a-285803750c97 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.455045 Aug 11 10:03:40.382360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 250/511] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:39 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:40.390197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc4d305-287b-4a37-9d4d-99ceb3e3f720", "tag": "13119f6c-980c-4766-a32c-a213e4198421"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:40.391900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:40.394004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:40.395351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f2ec6700-9a7d-4d01-b5a7-3261123e540b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1753 microversion: 2.20 time: 0.465312 Aug 11 10:03:40.401970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:40.402648 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:40.403162 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:40.409644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 262/512] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:39 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1753 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:40.414780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] Creating event network-changed:13119f6c-980c-4766-a32c-a213e4198421 for instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 on hv-cinder-81566 Aug 11 10:03:40.419700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-cd2bd256-c10c-4c96-a944-91ab5d884642 req-d6552d72-552c-4446-b39c-8171da0fc5b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035966 Aug 11 10:03:40.420299 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 251/513] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:40.477580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:40.478179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:40.484672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:40.485196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:40.485629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:40.486317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:40.486786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:40.487216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:40.625381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:40.634025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-609f7cd8-6b07-42ec-a076-9340837c180e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1682 microversion: 2.1 time: 0.161282 Aug 11 10:03:40.634610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 263/514] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:40 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:41.404752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:41.405395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:41.412179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.412662 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.413125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.413815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.414274 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.414702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.419593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:41.420189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:41.426566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.427084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.427550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.428230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.428670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.429109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.614998 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:41.618865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:41.623106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-46bfc0fb-5643-42bc-a053-0fbcfbbf4b32 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.223111 Aug 11 10:03:41.623689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 252/515] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:41 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:41.627190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:41.628731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:41.630414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-127ed8b6-0a7a-46b9-8ded-a4fa1a4c4fe5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1753 microversion: 2.20 time: 0.214109 Aug 11 10:03:41.631137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 264/516] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:41 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:41.655134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:41.655679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:41.661759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.662245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.662681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.663396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:41.663851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:41.664275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:41.804783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:41.812321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ec29d958-1ded-4bb0-a61b-0f18983fdefb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1682 microversion: 2.1 time: 0.160954 Aug 11 10:03:41.812886 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 253/517] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:41 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:42.644195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:42.644836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:42.654269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:42.655137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:42.655313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:42.655475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:42.656004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:42.656899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:42.657571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:42.658217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:42.662111 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:42.662626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:42.663027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:42.663714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:42.664191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:42.664603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:43.104898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:43.113187 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f55f60a4-bcb7-4c66-b5d6-7b14d7ed1ffa tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.472776 Aug 11 10:03:43.113757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 265/518] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:42 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:43.118995 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:43.119657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:43.125610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:43.130801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:43.130801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:43.130801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:43.130801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:43.131435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:43.131530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:43.141605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:43.143567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:43.144943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e5a12b7a-3e2c-4fbc-8d47-81b8ded8e591 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1753 microversion: 2.20 time: 0.494498 Aug 11 10:03:43.146369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 254/519] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:42 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1753 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:43.465809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:43.474470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bd12cb72-cc58-473c-8f53-a68cb881a825 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1682 microversion: 2.1 time: 0.359107 Aug 11 10:03:43.481878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 266/520] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:43 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1682 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:43.578115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-517355717", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "networks": [{"uuid": "f03007b8-fe93-4ccc-856a-1cad152aea8b"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:43.636210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] validate_networks() for [('f03007b8-fe93-4ccc-856a-1cad152aea8b', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:03:44.139336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:44.140096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:44.146509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:44.147600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:44.147600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:44.148447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:44.149003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:44.149552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:44.589570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:44.598251 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-83f7a3ed-ce8c-4fc7-8e83-95a211f34d39 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.463207 Aug 11 10:03:44.599385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 267/521] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:44 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:44.612254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:44.612254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:44.612254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:44.612254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:44.612599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:44.613171 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:44.613848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:44.614194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.025986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.044617 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.046127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.047289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2ef301ce-4871-46dc-b218-e17c388ef754 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.446925 Aug 11 10:03:45.047859 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 268/522] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:44 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:45.053508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:45.054371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:45.060666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.061571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.063262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.064200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.064664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.064942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.080833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:03:45.082093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:03:45.083756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:03:45.084430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:03:45.085183 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:03:45.095523 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.096690 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.096690 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.097320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.098014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.099317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.121782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Getting quotas for project dd2a37c402a64171aae8a8c90b89ce33. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:03:45.127259 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Getting quotas for user acd4018e26564721a8c16db0e9d2e0aa and project dd2a37c402a64171aae8a8c90b89ce33. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:03:45.147764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:03:45.152626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:03:45.235907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.250183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ff7c20a2-eb41-4c9c-8a6d-b17925c7c582 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.201296 Aug 11 10:03:45.251410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 269/523] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:45 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:45.343878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a65da9c0-517b-430a-abd2-e6f669dde015 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768978 Aug 11 10:03:45.353682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 255/524] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:03:45.356999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-22a7184e-a555-40ae-969c-3c4806414e36 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:45.358099 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-22a7184e-a555-40ae-969c-3c4806414e36 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:45.478140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-22a7184e-a555-40ae-969c-3c4806414e36 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.490561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-22a7184e-a555-40ae-969c-3c4806414e36 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1218 microversion: 2.1 time: 0.137831 Aug 11 10:03:45.501427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 270/525] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:45 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:45.594668 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfb9f02-1255-481b-b2df-bd1b4b8f9159", "name": "network-vif-deleted", "tag": "9cf7816f-b470-4208-8712-e05aa700d205"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:03:45.607993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.608797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.609886 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.621526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:45.622746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:45.639215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.639877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.640404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.641609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:45.643540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:45.644073 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:45.652167 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] Creating event network-vif-deleted:9cf7816f-b470-4208-8712-e05aa700d205 for instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 on hv-cinder-81566 Aug 11 10:03:45.672400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-b9954cec-e6f9-4796-ac51-593e495e1be4 req-93ac10ea-55ee-47d2-a515-dc01f7c56557 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082639 Aug 11 10:03:45.673402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 256/526] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:03:45.823094 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:45.834582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9ee3a7f6-b45a-4c4b-8753-b7ca5aeb160e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.217932 Aug 11 10:03:45.861126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 271/527] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:45 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:46.071502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:46.072435 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:46.090692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.091915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.092508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:46.093249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.093893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.094655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:46.279149 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:46.279771 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:46.294453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.294940 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.295367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:46.298520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.299283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.299580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:46.313571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:46.324609 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:46.327293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:46.330261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:46.332273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b495fb1c-9a13-471c-a4ce-3f57b63f6733 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.265213 Aug 11 10:03:46.334257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 257/528] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:46 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:46.427161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:46.440877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-aca81e68-5926-4e1d-972d-4829a6ca2644 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.167328 Aug 11 10:03:46.452837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 272/529] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:46 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:46.513794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f8dfc36f-68ca-4143-b370-671ec88bfa16 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:46.514477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f8dfc36f-68ca-4143-b370-671ec88bfa16 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:46.592581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f8dfc36f-68ca-4143-b370-671ec88bfa16 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:46.604847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f8dfc36f-68ca-4143-b370-671ec88bfa16 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1218 microversion: 2.1 time: 0.092216 Aug 11 10:03:46.605936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 258/530] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:46 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:46.859797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:46.860750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:46.868866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.869415 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.869851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:46.870547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:46.870992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:46.871402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.013348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.022119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0161b024-2999-4903-b5a2-1e89e48d561c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.166303 Aug 11 10:03:47.022687 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 273/531] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:46 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:47.357909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:47.358597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:47.366161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.366640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.367072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.367753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.368198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.368663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.467625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:47.469233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:47.488471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.488990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.490035 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.490745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.491193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.491610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.541499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.550510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.552842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.554133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0677244e-37ae-49eb-b793-870166c6227b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.200635 Aug 11 10:03:47.554965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 259/532] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:47 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:47.588556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.597332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7029e9de-0b38-4faa-bc4d-0a317a6a38d3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.134076 Aug 11 10:03:47.600755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 274/533] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:47 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:47.632635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:47.633401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:47.639847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.640314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.640742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.641495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:47.642096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:47.642683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:47.706808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:47.718203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-53f4e241-a780-4a78-9098-68ea1d0d0375 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.090657 Aug 11 10:03:47.719220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 260/534] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:47 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:48.043269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:48.043866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:48.049887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.050353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.050777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.051449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.052438 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.052852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.182137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.190477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3582cf9c-b24e-476c-805c-17a217940828 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.150737 Aug 11 10:03:48.190713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 275/535] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:48 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:48.578619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:48.579370 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:48.586833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.587312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.587739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.588518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.588970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.589414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.619611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:48.620227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:48.626717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.627196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.627622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.628310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.628790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.629284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.708584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.712599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:48.719166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8f239d1b-5470-4115-bea6-9f44eb47b150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.103219 Aug 11 10:03:48.729258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 276/536] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:48 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:48.749369 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:48.749369 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:48.751493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.752103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.752694 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.753677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:48.754257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:48.754834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:48.769500 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.780142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.783146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.784593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-623c4c82-3842-4c0c-a7d5-523ad26ccec9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.209941 Aug 11 10:03:48.793056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 261/537] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:48 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:48.846710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:48.855272 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a4260c7d-067c-4d35-9021-419a3b44be7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.119281 Aug 11 10:03:48.855857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 277/538] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:48 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:49.212836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:49.213568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:49.220168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.220753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.221280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.222061 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.222588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.223102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.357352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:49.365693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-08e47132-46e1-4ee1-a314-eb169ec627d8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.156768 Aug 11 10:03:49.366252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 262/539] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:49 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:49.742434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:49.743038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:49.749996 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.750477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.750906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.751584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.752036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.752484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.808387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:49.809003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:49.814339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:49.815434 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.815911 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.816336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.817040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.817555 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.817974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.822184 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f1a873ca-e9d5-47f0-9eb0-13d63f71728d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.084394 Aug 11 10:03:49.822754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 278/540] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:49 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:49.875727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:49.876346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:49.882288 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.882768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.883203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.883884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:49.884330 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:49.884746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:49.981878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:49.994135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-eb137c49-5cf2-42df-92ec-7814571be69d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.122210 Aug 11 10:03:49.995388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 279/541] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:49 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:50.015871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:50.028438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:50.030323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:50.031635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6e96e9b5-4f2a-4c2a-af53-400f319e6ba7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.227142 Aug 11 10:03:50.032199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 263/542] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:49 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:50.386922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:50.387533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:50.394322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:50.394969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:50.395574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:50.396534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:50.397130 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:50.397836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:50.530709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:50.539183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0cd67185-9342-4e84-b265-ed3d977eedf6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.156136 Aug 11 10:03:50.539767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 280/543] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:50 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:50.845295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:50.845929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:50.854225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:50.854713 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:50.855198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:50.855967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:50.856423 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:50.856845 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:50.922680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:50.930354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d75ebc47-6748-4adb-91a0-7303c287c49f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.090162 Aug 11 10:03:50.930926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 264/544] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:50 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:51.015401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:51.015957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:51.023041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.023519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.023948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.024629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.025097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.025516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.055336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:51.056210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:51.062236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.062785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.063284 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.064066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.064516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.064932 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.088625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:51.096350 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-559830c0-1734-4f6e-8e31-1f08ff631c44 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.084850 Aug 11 10:03:51.096925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 281/545] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:51 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:51.204854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:51.214697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:51.216436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:51.217656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-28d8c21b-4e6c-47fe-a7c5-e1e8fc625d54 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.166377 Aug 11 10:03:51.218499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 265/546] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:51 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:51.560400 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:51.561003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:51.567046 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.568136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.568576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.569299 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.569755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.570178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.709875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:51.718716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a5aa17d2-ee0a-49e7-8f5e-56d510a7a19d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.162075 Aug 11 10:03:51.719581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 282/547] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:51 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:51.951634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:51.952220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:51.958625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.959092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.959516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:51.960191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:51.960637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:51.961194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.032360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.040780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f2a9f086-8557-4bd9-a8a2-9575edfcfc02 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.093027 Aug 11 10:03:52.045172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 266/548] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:51 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:52.118991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:52.119729 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:52.126111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.126594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.127054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.127736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.128248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.128678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.188524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.196059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cb57f683-a024-4893-bf98-7c4ea48e1433 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.081580 Aug 11 10:03:52.196622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 283/549] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:52 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:52.242160 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:52.242702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:52.248594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.249105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.249544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.250230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.250685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.251108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.397189 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.406472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.408120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.409371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-da510f7f-efcb-498f-aaae-4163344114fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.172047 Aug 11 10:03:52.409924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 267/550] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:52 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:52.740217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:52.740843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:52.746856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.747359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.747788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.748468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:52.748915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:52.749358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:52.877731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:52.885897 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4b9f6ac9-1dd3-451a-b1a6-d4b0d6c52dd3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.150140 Aug 11 10:03:52.886468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 284/551] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:52 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:53.063106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:53.064486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:53.071621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.072119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.072526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.073267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.073718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.074167 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.137192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:53.144626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-82888bd5-a49f-4c9a-94c6-16a3484d5e87 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.085384 Aug 11 10:03:53.145281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 268/552] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:53 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:53.218302 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:53.219032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:53.227726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.228531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.229185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.230300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.230861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.231385 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.295839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:53.305927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-399deb8f-77ad-4025-ad52-bbee0c22e794 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.092484 Aug 11 10:03:53.306768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 285/553] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:53 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:53.433749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:53.442048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:53.442048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.442048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.442048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.442440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.442440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.442720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.599785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:53.608624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:53.610270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:53.611506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-00b548ad-869b-4d00-bebd-6c378835cba9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.181665 Aug 11 10:03:53.612069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 269/554] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:53 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:53.906705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:53.907305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:53.914189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.914665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.915101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:53.915777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:53.916225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:53.916642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.046689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.054675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-21d3d52c-bfba-438d-b63f-5f268e9419a4 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.152010 Aug 11 10:03:54.055236 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 286/555] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:53 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:54.166961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:54.167521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:54.174125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.174608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.175086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.175753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.176186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.176655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.251543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.259915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-24fe03b5-042e-423d-a5d3-65f76511745f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.096867 Aug 11 10:03:54.264094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 270/556] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:54 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:54.326299 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:54.326958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:54.334080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.334603 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.335038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.335723 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.336172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.336594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.397762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.404994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1090d147-fa8a-48b0-b6be-a37588e56e23 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.082596 Aug 11 10:03:54.405573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 287/557] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:54 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:54.636225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:54.640321 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:54.649477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.650212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.650654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.651574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:54.652031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:54.652454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:54.786970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.795325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.796805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:54.797986 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-812d9e98-c7d5-4d43-a01d-f42b6d590273 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.166360 Aug 11 10:03:54.798547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 271/558] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:54 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:03:55.075713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:55.076306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:55.082433 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.083244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.083758 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.084454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.084908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.085355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.217787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:55.226453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7de5ad81-a6b0-4013-9b69-8904eb6a9664 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.154577 Aug 11 10:03:55.227017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 288/559] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:55 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:55.281675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:55.282277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:55.284097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:55.289879 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.290359 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.290789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.291471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.291921 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.292340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.353910 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:55.361262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-29def7b5-4e42-446a-801a-bb3077a96a94 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.083322 Aug 11 10:03:55.361851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 272/560] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:55 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:55.425342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:55.425964 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:55.432278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.432870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.433396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.434210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.434811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.435349 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.482169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:55.746785 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:55.756407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a16350b9-c85b-413b-9d19-1970b8bc736f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.334658 Aug 11 10:03:55.757146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 289/561] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:55 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:55.821768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:55.822862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:55.836334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.837317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.837956 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.838869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:55.839482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:55.840064 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:55.990219 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.048139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.048139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.048139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f16519da-d5df-4303-ac2a-8c4865d47779 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.185165 Aug 11 10:03:56.048571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 273/562] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:55 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:56.248986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:56.249687 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:56.256983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.257413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.257834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.258753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.258989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.259421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.383020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:56.383688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:56.390315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.390800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.391230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.391917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.392367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.392782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.400900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.408904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-16ad78f6-7aa7-480b-adb8-21f29d64936d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.163831 Aug 11 10:03:56.409511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 290/563] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:56 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:56.454780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.462970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4e67526b-6010-471f-9ecb-1864f18f879f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.084432 Aug 11 10:03:56.463690 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 274/564] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:56 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:56.780074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:56.780677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:56.784033 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:56.787736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.788217 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.788652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.789358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:56.789812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:56.790237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:56.851251 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:56.859624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-632982cd-e99a-4b78-83d3-a32a6136f4f1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.083173 Aug 11 10:03:56.860362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 291/565] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:56 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:57.069952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:57.070554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:57.072399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=8 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:57.077169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.078381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.078381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.078884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.079340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.079763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.098022 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:57.217744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.226795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.228278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.229473 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f395b1ec-eb23-4e3a-b351-cc2a43f11f8f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.164016 Aug 11 10:03:57.230019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 275/566] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:57 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:57.432007 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:57.432527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:57.439076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.439545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.439967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.440726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.441197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.441638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.484464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:57.485116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:57.492542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.493058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.493497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.494195 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.494649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.495069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.565264 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.573007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-105a37cb-ff39-4928-a7f4-781b85eb374d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1614 microversion: 2.1 time: 0.092388 Aug 11 10:03:57.573668 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 276/567] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:57 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:57.595177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.603770 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f1fccad7-8a55-4af7-998d-1c1801eaadb2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.177098 Aug 11 10:03:57.604326 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 292/568] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:57 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:57.882784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:57.883380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:57.889422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.889909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.890349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.891044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:57.891553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:57.891927 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:57.957348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:57.966136 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fd87fd92-70a6-41ff-b26f-062269620bb5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1222 microversion: 2.1 time: 0.087099 Aug 11 10:03:57.972241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 277/569] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:57 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:58.253827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:58.255043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:58.261650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.262135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.262573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.263257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.263709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.264132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.282805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:58.401259 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:58.409784 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:58.411274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:58.412426 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-655b5252-a43e-4f99-85b7-c815d655029c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.162496 Aug 11 10:03:58.412997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 293/570] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:58 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:58.595274 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:58.595881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:58.602414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.602899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.603328 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.604008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.604457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.604875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.624430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:58.625044 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:58.631905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.632419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.632899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.633772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.634339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.634870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.636833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.637346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.637775 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.638215 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'fault' on Instance uuid ddfb9f02-1255-481b-b2df-bd1b4b8f9159 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:58.681605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:58.689242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-41a54274-27d1-4fb9-b9a1-dec9531d669d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1332 microversion: 2.1 time: 0.097759 Aug 11 10:03:58.689823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 278/571] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:58 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:58.779949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:58.788538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ef83e3dd-e077-41da-802f-9ab2614a88c8 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.167845 Aug 11 10:03:58.789117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 294/572] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:58 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:03:58.986666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:58.987188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:58.994014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.994489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.994915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:58.995590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:58.996035 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:58.996457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.056789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.064385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-704e96b7-a7d7-4f93-941b-643b8976eb63 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1214 microversion: 2.1 time: 0.081656 Aug 11 10:03:59.065624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 279/573] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:58 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:59.436538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:59.437164 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:59.443870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.445418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.445418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.445680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.446131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.446545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.578777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.587946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.589500 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.590936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-29c36ffb-28f5-4967-b858-3293de57b04d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.158902 Aug 11 10:03:59.591482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 295/574] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:03:59 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:03:59.710203 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:59.710733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:59.716806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.717307 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.717735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.718413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.718862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.719278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.750357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.750891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.751320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.751768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'fault' on Instance uuid ddfb9f02-1255-481b-b2df-bd1b4b8f9159 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:03:59.792822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.800225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ed39397a-808c-4060-bfda-91047d492cf8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1332 microversion: 2.1 time: 0.094086 Aug 11 10:03:59.800787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 280/575] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:59 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:03:59.810057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:03:59.810681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:03:59.816593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.817254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.817777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.818458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:03:59.818916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:03:59.819340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:03:59.952038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:03:59.960475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7d2d7013-a10d-4a45-ac40-ccc71e938cd5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.154146 Aug 11 10:03:59.960974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 296/576] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:03:59 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:00.097427 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:00.098045 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:00.105070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.105544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.105973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.106646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.107092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.107505 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.167547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:00.174896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d9781361-a538-4142-ba69-23638a472c00 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1270 microversion: 2.1 time: 0.081282 Aug 11 10:04:00.175460 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 281/577] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:00 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:00.615234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:00.615824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:00.621951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.622446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.622849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.623516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.623960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.624373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.756267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:00.764623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:00.766194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:00.767336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c5a65485-8602-4b47-91fc-2439ef409559 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.156701 Aug 11 10:04:00.767882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 297/578] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:00 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:04:00.822395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:00.823004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:00.824825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:00.829704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.830188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.830622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.831308 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.831759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.832194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.862002 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.862475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.862905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.863348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'fault' on Instance uuid ddfb9f02-1255-481b-b2df-bd1b4b8f9159 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:04:00.905671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:00.913182 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7ccc3dd3-8b22-4d4d-b172-16048e9d7664 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 200 len: 1332 microversion: 2.1 time: 0.094603 Aug 11 10:04:00.913752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 282/579] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:00 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:00.982780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:00.983375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:00.990069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.990546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.990972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:00.991642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:00.992085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:00.992498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.118836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:01.126727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-34208c1b-337c-45bc-aaab-85e678ebdea3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.147914 Aug 11 10:04:01.127279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 298/580] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:00 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:01.196037 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:01.197289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:01.204888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.205401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.205834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.206523 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.206972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.207463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.269834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:01.277688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9ff7be2a-2746-4055-be27-09a9945a09df tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1270 microversion: 2.1 time: 0.086078 Aug 11 10:04:01.278245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 283/581] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:01 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:01.790323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:01.790967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:01.797414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.797889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.798387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.799069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.799518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.799936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.931223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:01.934353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:01.934962 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:01.939624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:01.940728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.941117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:01.941246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.941653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.942262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-43a628fa-c8f0-4916-bbed-60ffbbd73815 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.156561 Aug 11 10:04:01.942366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:01.942811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:01.943148 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 299/582] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:01 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:01.943438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:01.956590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 HTTP/1.1 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:04:01.958295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:04:01.960415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'ddfb9f02-1255-481b-b2df-bd1b4b8f9159'} Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:04:01.961197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:04:01.962362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:04:01.963467 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:04:01.963467 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-643c9c94-2c19-4c63-9369-9ebbf2575780 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 404 len: 111 microversion: 2.1 time: 0.029085 Aug 11 10:04:01.963467 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 284/583] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:01 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:04:01.969101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4fb4e2ba-e741-4ae8-9ca4-9e10bded1b32 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '.version_select at 0x7f787c1365e0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:02.022031 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4fb4e2ba-e741-4ae8-9ca4-9e10bded1b32 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312777794" status: 202 len: 0 microversion: 2.1 time: 0.056783 Aug 11 10:04:02.022609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 300/584] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Aug 11 10:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312777794 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 10:04:02.148175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:02.149081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:02.155014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.155502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.158994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:02.158994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.158994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.158994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:02.299631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:02.300215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:02.308171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:02.308982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.309506 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.309936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:02.310686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.311143 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.311566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:02.323267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-100fb186-0f40-462d-a2ee-42f63772b73d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.179359 Aug 11 10:04:02.337977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 285/585] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:02 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:02.426500 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:02.435243 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-684f040e-af8e-4a36-bf2d-d4eafbc9f4d0 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1278 microversion: 2.1 time: 0.140738 Aug 11 10:04:02.435815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 301/586] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:02 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:02.794141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3b8a20fb-2f97-49cb-aad1-06ee0d0f8258 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: .version_select at 0x7f787c161670>, body: {"keypair": {"name": "tempest-keypair-613314074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpOjQCezADak6iPDs/xzybbZrXvk9GUlconF/LWci/5RuqpQ7jXxPMBnhzWE9eu+PU47QTJCNX/yBZ4j9S/Ta+Rr8wKDKjBE8aeRsEpUp6XD+mthZHOIJNdyOTaGWINtA=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:02.813111 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-3b8a20fb-2f97-49cb-aad1-06ee0d0f8258 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:04:02.817087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-3b8a20fb-2f97-49cb-aad1-06ee0d0f8258 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:04:02.879796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3b8a20fb-2f97-49cb-aad1-06ee0d0f8258 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097576 Aug 11 10:04:02.880533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 286/587] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:04:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:02.965768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:02.966366 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:02.972856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.973426 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.984614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:02.984614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:02.984614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:02.984614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:03.218540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:03.242635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:03.243907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:03.246083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a8d3c74-fecb-47b8-b6f0-899f513b5202 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.284407 Aug 11 10:04:03.246957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 302/588] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:02 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:03.347751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:03.348377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:03.354476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:03.354950 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:03.355381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:03.356128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:03.356510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:03.356922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:03.457365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:03.459201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:03.466791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:03.467490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:03.468080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:03.468772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:03.469248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:03.470115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:03.609578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:03.619178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ef376e66-05bc-41d6-bb9b-46d8075550d7 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1733 microversion: 2.1 time: 0.275707 Aug 11 10:04:03.620071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 287/589] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:03 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1733 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:03.647373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:03.655057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-21a61e91-24d7-43bb-ae81-06297f2743c7 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.202110 Aug 11 10:04:03.655695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 303/590] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:03 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:04.271808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:04.272400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:04.279242 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.280494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.280939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.282197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.282661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.283093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.500635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:04.517117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:04.518619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:04.519794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4bb8a294-b46f-49e6-ae3b-c8e5bcf7151d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.252478 Aug 11 10:04:04.520351 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 288/591] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:04 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:04.649693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:04.652974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84d407a-ac5d-44fe-b83b-38c3dd58234b", "tag": "d5b385be-5584-4b78-bb69-60e0a2c29b24"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:04.655184 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:04.670058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.673316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.674002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.674907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.678472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.681359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.681359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.682230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.684112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.713530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] Creating event network-changed:d5b385be-5584-4b78-bb69-60e0a2c29b24 for instance e84d407a-ac5d-44fe-b83b-38c3dd58234b on hv-cinder-81566 Aug 11 10:04:04.719561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-73da064f-d718-48cf-8329-e1b8dbbac96f req-ee2f5a12-0181-4457-97d4-fc1cdc45e1ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074265 Aug 11 10:04:04.725221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 289/592] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:04.732637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:04.733534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:04.741360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.741996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.742535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:04.743332 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:04.743883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:04.744545 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.012871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:05.023506 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-89e508ca-5ede-400f-8d31-1ecc05c6cf3a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1713 microversion: 2.1 time: 0.381429 Aug 11 10:04:05.024093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 304/593] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:04 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1713 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:05.028962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "name": "network-vif-plugged", "status": "completed", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:05.038811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.039288 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.039895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.055319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] Creating event network-vif-plugged:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:04:05.064801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-a5a85109-3442-4ffb-b8e5-f428d2444d12 req-5f2e3fc1-d1cd-4df0-bb88-d3f79c870394 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 Aug 11 10:04:05.065671 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 305/594] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:05.077197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:05.088275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-79fb0765-cb02-4803-a742-206ede5fe30f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.361439 Aug 11 10:04:05.089257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 290/595] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:04 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:05.164599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:05.165457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:05.171957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.172669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.173169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.173864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.174312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.174725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.271440 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] HTTP exception thrown: Cannot 'detach_volume' instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef while it is in vm_state rescued Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Request method failure captured: Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments/bdbc952a-7052-4e68-8d09-0733c0ec5176 HTTP/1.1 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMQjZw7kFhz9g7LEJQsP-iH5ffu3I5awbWKeum2tTjFcw3C92yp9ymdQrILi1Kq0kmatFh7l0U91YYXlb0PpqBeC2XutFi7zptgUJkrKAnWo3607IitA058X3blz5YHT6Gbo8pnhbBDlUvY-ZXSxdNxrzfbTHo4fBh42H3Qm6AxpaM Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:04:05.273049 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: c62f05ea732142c1af1c09dd23e7b9a3 Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:04:05.274563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Cannot 'detach_volume' instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef while it is in vm_state rescued Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'server_id': '7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef', 'id': 'bdbc952a-7052-4e68-8d09-0733c0ec5176'} Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:04:05.275373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef while it is in vm_state rescued Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef while it is in vm_state rescued Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:05.276799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Returning 409 to user: Cannot 'detach_volume' instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef while it is in vm_state rescued {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:04:05.277973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c997a049-8532-40c8-aca5-9cecaec1fd31 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments/bdbc952a-7052-4e68-8d09-0733c0ec5176" status: 409 len: 152 microversion: 2.1 time: 0.114602 Aug 11 10:04:05.277973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 306/596] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:04:05 2022] DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments/bdbc952a-7052-4e68-8d09-0733c0ec5176 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 11 10:04:05.283309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:05.283843 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:05.290597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.291082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.291517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.292204 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.292659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.293106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.400321 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-683169880", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d20a0340-e393-4428-8a14-1335a616fcac"}], "security_groups": [{"name": "tempest-securitygroup--1904297331"}], "key_name": "tempest-keypair-613314074", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:05.459100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f6e9fd4a-3abb-40cd-952d-70e0344d24bb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/action" status: 202 len: 0 microversion: 2.1 time: 0.179305 Aug 11 10:04:05.459799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 291/597] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:04:05 2022] POST /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:04:05.468322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:05.469036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:05.476164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.476878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.477344 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.478044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.478501 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.478922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.505969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:05.518109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] validate_networks() for [('d20a0340-e393-4428-8a14-1335a616fcac', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:04:05.867103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:05.875232 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-50b7a901-5332-4d13-b469-dab8dcc98453 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1721 microversion: 2.1 time: 0.411105 Aug 11 10:04:05.875806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 292/598] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:05 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1721 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:05.881578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:05.882185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:05.887970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.888454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.888886 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:05.889604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:05.890419 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:05.890708 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.539333 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:06.547832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:06.550470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:06.550699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1eb0a1d7-6bcd-44c7-bafb-356d98488dca tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.673732 Aug 11 10:04:06.551260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 293/599] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:05 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:06.572043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:06.572653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:06.580833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.581343 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.581770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.582462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.582913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.583891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.774571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:04:06.775083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:04:06.775443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:04:06.775869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:04:06.776270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:04:06.785173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.785652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.786093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.787456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.787844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.788260 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.805637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:04:06.809570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:04:06.820473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:04:06.822754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:04:06.864836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:06.864836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-199d72e2-b744-4bbd-95bd-41cdc2d5bb84 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.291854 Aug 11 10:04:06.864836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 294/600] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:06 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:06.897031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:06.898175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:06.903622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.904148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.904589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.905327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:06.905782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:06.906202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:06.960892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-192f8fa2-febe-4f0c-a398-0caea88b14b6 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.565251 Aug 11 10:04:06.961958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 307/601] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:04:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 10:04:06.973161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ea77540e-6884-43bc-9fa9-54abfcd7a0a8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:06.973781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ea77540e-6884-43bc-9fa9-54abfcd7a0a8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:07.039345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea77540e-6884-43bc-9fa9-54abfcd7a0a8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:07.046407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ea77540e-6884-43bc-9fa9-54abfcd7a0a8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1240 microversion: 2.1 time: 0.077156 Aug 11 10:04:07.046985 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 308/602] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:06 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:07.070290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:07.078096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b58aceeb-4634-4207-a977-b467d4fda3a3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1721 microversion: 2.1 time: 0.185654 Aug 11 10:04:07.078762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 295/603] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:06 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:07.574722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:07.575337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:07.581283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:07.581765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:07.582192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:07.582894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:07.583420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:07.583994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:07.717612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:07.727171 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:07.728766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:07.730127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-93039a2b-5bc4-47de-aa5f-52dafc7f7b9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.159438 Aug 11 10:04:07.730684 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 309/604] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:07 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:07.881628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:07.882230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:07.888147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:07.888595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:07.889032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:07.889717 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:07.890163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:07.890580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.021758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.029126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fe99a78c-dc63-487f-b2d3-2d114bc42a89 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.152354 Aug 11 10:04:08.029696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 296/605] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:07 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:08.067162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:08.068422 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:08.074720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.075203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.075629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.076342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.076789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.077237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.099780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:08.100396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:08.106345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.106834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.107271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.107968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.108426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.108851 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.139681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.147163 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1efd2745-b118-46e9-84fa-49d8332c04f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1244 microversion: 2.1 time: 0.083842 Aug 11 10:04:08.147730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 310/606] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:08 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:08.243343 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.251209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7ad856a4-ea9e-4d9c-8cf5-8ab9ee62be3c tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1721 microversion: 2.1 time: 0.155377 Aug 11 10:04:08.251762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 297/607] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:08 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:08.754507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:08.755290 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:08.761878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.762365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.762863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.763590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:08.764042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:08.764460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:08.907232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.916339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.917837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:08.919080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ede70f31-e94f-42d2-a6bb-74881e9475f0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.168661 Aug 11 10:04:08.919627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 311/608] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:08 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:09.050060 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:09.050584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:09.057240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.057838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.058267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.058944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.059393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.059813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.168332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:09.168929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:09.175196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.175674 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.176159 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.177036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.177579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.177997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.202614 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:09.207012 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a5f4ae32-9009-4449-87b1-a2aa987cc3d3 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.160857 Aug 11 10:04:09.208564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 298/609] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:09 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:09.248968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:09.258266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-35c57f67-9fad-4f46-8793-abfc327c0f8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1244 microversion: 2.1 time: 0.093695 Aug 11 10:04:09.269121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 312/610] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:09 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:09.275248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:09.277437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:09.282144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.282632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.283065 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.283759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.284211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.284638 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.426941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:09.435066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a89117d4-7aa4-4083-95ba-6e6e7b7b8fd0 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1721 microversion: 2.1 time: 0.164927 Aug 11 10:04:09.435619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 299/611] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:09 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:09.942009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:09.943100 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:09.949514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.949988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.950414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.951087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:09.951534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:09.951951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:09.969798 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:10.078880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.087166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.088642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.089808 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cfb538f7-d03e-4ce3-bd1d-b76e05ebeb5e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.151770 Aug 11 10:04:10.090360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 313/612] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:09 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:10.230315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:10.230852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:10.237291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.237768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.238210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.238887 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.240043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.240470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.279864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:10.280468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:10.287096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.287577 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.288001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.288688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.289175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.289594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.364015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.371627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5343bcda-1241-406e-8cc0-939346fa11ff tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1292 microversion: 2.1 time: 0.095517 Aug 11 10:04:10.372198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 314/613] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:10 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:10.393823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.401945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-58767b83-8528-4312-9f95-e92b4529fb38 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.175526 Aug 11 10:04:10.402509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 300/614] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:10 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:10.456103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:10.456706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:10.463381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.463859 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.464291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.464970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.465444 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.466132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.594012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:10.602618 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-64d26fdd-0a1b-4c22-ba9c-27f60f6e9652 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1721 microversion: 2.1 time: 0.150320 Aug 11 10:04:10.603189 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 315/615] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:10 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:10.753868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84d407a-ac5d-44fe-b83b-38c3dd58234b", "name": "network-vif-plugged", "status": "completed", "tag": "d5b385be-5584-4b78-bb69-60e0a2c29b24"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:10.764103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:10.769722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:10.769722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:10.776578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] Creating event network-vif-plugged:d5b385be-5584-4b78-bb69-60e0a2c29b24 for instance e84d407a-ac5d-44fe-b83b-38c3dd58234b on hv-cinder-81566 Aug 11 10:04:10.781530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-7d4d9427-ea9f-4f0d-aea8-f03d86bb71b1 req-8b8800e9-58ad-4ae6-964b-19b9b73f6a49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Aug 11 10:04:10.782104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 301/616] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:11.113692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.114890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.121518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.121993 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.122413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.123084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.123548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.123967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.259817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.268267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.269824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.271346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7766d243-83bb-4eb7-8b42-1825445002ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1809 microversion: 2.20 time: 0.161588 Aug 11 10:04:11.271913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 316/617] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:11.393034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.393669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.399986 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.400466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.400901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.401649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.402102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.402528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.423035 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.423653 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.430789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.431281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.431719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.432407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.432860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.433332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.467804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.476420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-277acda8-9624-4caa-983d-95a4164107f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1292 microversion: 2.1 time: 0.088200 Aug 11 10:04:11.477003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 302/618] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:11.567006 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.574499 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-80f53468-7251-48e9-a883-8c0e8d7ceb26 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.155250 Aug 11 10:04:11.575065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 317/619] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:11.622954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.623559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.629345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.629822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.630308 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.631128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.631579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.631996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.766580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:11.774850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3daeaec1-5b00-418f-aab7-6cb970b2c19b tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1727 microversion: 2.1 time: 0.155725 Aug 11 10:04:11.775414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 303/620] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:11.795613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.796096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.802616 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.803393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.803825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.804703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.805203 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.805812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.871805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.875117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.882113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.882623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.883065 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.884692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.884692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.885186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.887467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-16f7cb61-b6d6-42ff-956b-434b01108719 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095741 Aug 11 10:04:11.888064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 318/621] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:11.916658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fbd600af-89e0-47ba-8e0b-a80b086eb968 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048868 Aug 11 10:04:11.917364 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 304/622] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:04:11 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 10:04:11.979821 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:11.980315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:11.987219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.987708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.988142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:11.989059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:11.989554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:11.990239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.015310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:04:12.244367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-038c2901-8af6-4208-9ccd-4d40aa9916fc tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 204 len: 0 microversion: 2.1 time: 0.268070 Aug 11 10:04:12.244957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 319/623] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:04:11 2022] DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:04:12.253139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:12.253750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:12.260397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.260883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.261360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.262047 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.262501 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.262924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.296355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:12.297494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:12.304150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.304756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.305441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.306209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.306753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.307353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.607046 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.615365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-df13a2b6-b1b6-4716-af82-a4925a164f64 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1673 microversion: 2.1 time: 0.365525 Aug 11 10:04:12.616196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 305/624] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:12 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1673 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:12.622082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.627471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:12.633516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.635006 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.636161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-47fe7961-7400-40a9-a81f-d10b2a5ebb2f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1796 microversion: 2.20 time: 0.345537 Aug 11 10:04:12.636714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 320/625] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:04:12 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1796 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:04:12.638062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:12.643969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.644456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.645078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.646348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.646811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.647236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.655338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:12.655929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:12.661822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.662522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.663117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.663810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.664261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.664676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.723170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.731430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-596c2342-8b4e-49c2-8288-5404a31120aa tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1300 microversion: 2.1 time: 0.114059 Aug 11 10:04:12.732143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 306/626] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:12 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:12.817092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:12.825276 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a7496943-8d19-4543-a65a-d3e02f715d7f tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.187495 Aug 11 10:04:12.826566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:12.836043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:12.838271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 321/627] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:12 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:12.838677 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:12.839298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:12.839867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:12.853470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] Creating event network-changed:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:04:12.858486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-dad5ac3e-4ee2-497e-b7b4-11a891994263 req-bfa04194-c719-4d7a-a498-cf5a8a154ff3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035418 Aug 11 10:04:12.859291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 307/628] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:13.636559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:13.637287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:13.643924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.644472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.644969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.645864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.646483 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.647100 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.752930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:13.753661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:13.760373 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.760854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.761311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.761993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.762439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.762852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.774688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:13.782206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7bfac55e-47f7-4719-96bb-14069f37cf27 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1673 microversion: 2.1 time: 0.149711 Aug 11 10:04:13.782854 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 322/629] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:13 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:13.824961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:13.832367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1b46bdad-8495-4495-a136-e4ac2f3a2810 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1300 microversion: 2.1 time: 0.084087 Aug 11 10:04:13.832928 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 308/630] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:13 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:13.847730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:13.848358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:13.854918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.855394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.855818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.856490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:13.856930 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:13.857365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:13.986387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:13.994809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a5a8ad0b-982c-4c94-af5e-8ee9ff9667ad tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.151154 Aug 11 10:04:13.995373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 323/631] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:13 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:14.804263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:14.804942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:14.811583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:14.812060 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:14.812485 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:14.813197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:14.813649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:14.814068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:14.852809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:14.853440 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:14.860411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:14.860411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:14.860751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:14.861467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:14.861915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:14.862335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:14.981877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:14.989638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ac9dad98-e8cd-468c-aefd-6f13e18b980e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1310 microversion: 2.1 time: 0.140396 Aug 11 10:04:15.001335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 324/632] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:14 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1310 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:15.004845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:15.026524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:15.027002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:15.027431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:15.039488 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] Creating event network-changed:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:04:15.044403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-77c017d2-70e6-4513-9d22-c7d2b68e39d0 req-57dfd91f-c1e9-4929-947a-8a73afcdee36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049098 Aug 11 10:04:15.045000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 325/633] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:15.050069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:15.050750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:15.060990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:15.060990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:15.060990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:15.060990 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:15.061418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:15.061418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:15.367636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:15.375563 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7e83b584-70bb-4f29-8136-e44fcfc9055b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1673 microversion: 2.1 time: 0.575796 Aug 11 10:04:15.376328 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 309/634] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:14 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1673 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:15.569503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:15.576981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f1bd8323-3102-4adc-9467-1e0dba980393 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1318 microversion: 2.1 time: 0.530797 Aug 11 10:04:15.577641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 326/635] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:15 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:16.020900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:16.022190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:16.028686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.029210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.029642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.030499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.030959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.031498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.049758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:16.139162 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:16.146500 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6cac7df3-4278-4d56-b924-0b3232dbde8a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1298 microversion: 2.1 time: 0.129562 Aug 11 10:04:16.147262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 310/636] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:16 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:16.398992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:16.399605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:16.406767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.407261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.407697 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.408428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.408880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.409552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.599562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:16.600455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:16.606962 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.607759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.615550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.615550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:16.615550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:16.615550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:16.796387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:16.841829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:16.849876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a74fac4e-5058-4242-a33b-b9f9152ed043 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1673 microversion: 2.1 time: 0.455019 Aug 11 10:04:16.851090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 327/637] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:16 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1673 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:17.040015 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:17.047467 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-142a1eba-c408-41ad-87c3-989dc8465112 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1506 microversion: 2.1 time: 0.453213 Aug 11 10:04:17.048035 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 311/638] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:16 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:17.068981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74fb2a19-d899-43bb-a9fa-985840800197", "device": "/dev/sdb"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:17.071392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:17.073632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=8 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:17.075610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:17.079246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.081483 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.081483 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.081483 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.081483 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.081844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.174166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:17.174820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:17.181988 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.182467 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.182904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.183785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.184514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.187600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.660938 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:17.810638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d2fd7371-23aa-406f-8836-ff74105e3f85 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "POST /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745137 Aug 11 10:04:17.811314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 328/639] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:04:17 2022] POST /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:17.860474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:17.872688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6638bf7f-88ff-46cf-a747-480e0b22d469 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.702828 Aug 11 10:04:17.873535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 312/640] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:17 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:17.893769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:17.896306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:17.916615 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.917311 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.918040 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.919861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.920331 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.920763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.930581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e982719f-0cc3-44b1-aebb-f7832a9e7440", "name": "network-vif-deleted", "tag": "576ef535-ab3b-48c0-8bed-8b51e76c62c5"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:17.944048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:17.944781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:17.945453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:17.983288 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] Creating event network-vif-deleted:576ef535-ab3b-48c0-8bed-8b51e76c62c5 for instance e982719f-0cc3-44b1-aebb-f7832a9e7440 on hv-cinder-81566 Aug 11 10:04:17.995606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-0de11d9f-2a56-414f-b956-530c764b9e7d req-be0569f8-771c-43ac-9eb3-14d85b4ca99d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066808 Aug 11 10:04:17.998063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 313/641] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:04:18.028967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:18.042237 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6ad0c081-91f8-412b-86e6-9e1167877a4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 200 len: 1605 microversion: 2.1 time: 0.172865 Aug 11 10:04:18.053637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 329/642] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:17 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:18.899147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:18.899936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:18.906924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:18.907462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:18.907909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:18.908842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:18.909496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:18.909981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:19.064348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:19.065651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:19.074135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:19.074621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:19.075625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:19.076332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:19.076784 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:19.077442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:19.092718 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 HTTP/1.1 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:04:19.094447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:04:19.096019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'e982719f-0cc3-44b1-aebb-f7832a9e7440'} Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:04:19.096831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:04:19.098365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:19.099892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:04:19.099892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e28af0d5-63c3-4661-aaa2-32174a122a87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 404 len: 111 microversion: 2.1 time: 0.035486 Aug 11 10:04:19.099892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 330/643] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:19 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:04:19.105128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1f0a974b-5149-4c65-8a29-fb727211303f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '.version_select at 0x7f787c1e9820>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:19.156606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:19.159919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1f0a974b-5149-4c65-8a29-fb727211303f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594233852" status: 202 len: 0 microversion: 2.1 time: 0.058553 Aug 11 10:04:19.160498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 331/644] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Aug 11 10:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594233852 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 10:04:19.165818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-034241b0-3ebc-4f4e-8f5d-ae6e6bbfb3ea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.272336 Aug 11 10:04:19.166655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 314/645] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:18 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:19.861671 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2ef4c42e-e989-4811-9032-7726fa1619ab tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: .version_select at 0x7f787c147a60>, body: {"keypair": {"name": "tempest-keypair-1164249943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnvAE4l9UIDSAkDBAQ7rMKSinffS4Gf/TnM6+pdC0oTTJpqaFeiejzpjsjD6rxb2a+o1YibxIeFOOjXvi2n7D7rxELLPGgryBd++TmaCvRhuYW57uWkUyuebhXRze24cg=="}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:19.878074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-2ef4c42e-e989-4811-9032-7726fa1619ab tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for project 90177d2267614a389ae39922cba114e2. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:04:19.881872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-2ef4c42e-e989-4811-9032-7726fa1619ab tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for user d6c2fc568ee74d35bba01c6ce294edeb and project 90177d2267614a389ae39922cba114e2. Resources: {'key_pairs'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:04:19.953738 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2ef4c42e-e989-4811-9032-7726fa1619ab tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096094 Aug 11 10:04:19.954338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 332/646] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:04:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:20.010774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce8ed1-33bd-4a45-8348-edc91b8fb137", "tag": "e51e7474-f101-49dc-99e5-205ef1c34926"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:20.020594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:20.021252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:20.021679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:20.032629 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] Creating event network-changed:e51e7474-f101-49dc-99e5-205ef1c34926 for instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 on hv-cinder-81566 Aug 11 10:04:20.038225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-43f861bd-f8b1-4eb0-a21f-c4735bbcdefa req-dcf1e893-16c3-4a08-b8ca-14a908dad88d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031085 Aug 11 10:04:20.038999 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 315/647] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:20.191269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:20.191875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:20.198367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:20.202997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:20.202997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:20.202997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:20.202997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:20.203358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:20.356745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:20.366035 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a8043e1-17c2-41d0-af5c-98a82fec06ed tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.178645 Aug 11 10:04:20.366963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 333/648] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:20 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:21.388041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:21.388802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:21.396572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:21.397204 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:21.397669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:21.398399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:21.398850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:21.399279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:21.531363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:21.539002 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0c1c6f57-e1ce-47f0-a6d3-92aa4d2320d0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.155313 Aug 11 10:04:21.539683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 316/649] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:21 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:22.165901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-915072181", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0a83679-e7d2-4fa4-ab76-ec21cc24e038"}], "security_groups": [{"name": "tempest-securitygroup--1659517992"}], "key_name": "tempest-keypair-1164249943", "user_data": "}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:22.266119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] validate_networks() for [('b0a83679-e7d2-4fa4-ab76-ec21cc24e038', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:04:22.559767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:22.560375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:22.566766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:22.567821 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:22.568272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:22.568966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:22.569448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:22.569874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:22.666244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:04:22.666670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:04:22.667142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:04:22.667548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:04:22.667954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:04:22.677210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:22.677692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:22.678128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:22.678841 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:22.679292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:22.679712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:22.698384 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for project 90177d2267614a389ae39922cba114e2. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:04:22.701981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Getting quotas for user d6c2fc568ee74d35bba01c6ce294edeb and project 90177d2267614a389ae39922cba114e2. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:04:22.713561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:04:22.716163 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:04:22.729224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:22.737954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-20106459-7cc6-4e1f-a932-a05779c0bc19 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.182060 Aug 11 10:04:22.738739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 317/650] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:22 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:22.805843 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fce8ed1-33bd-4a45-8348-edc91b8fb137", "name": "network-vif-plugged", "status": "completed", "tag": "e51e7474-f101-49dc-99e5-205ef1c34926"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:22.815201 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:22.815678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:22.816103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:22.818225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a7344bd6-f39f-43c7-b3b4-6d8242338668 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.657082 Aug 11 10:04:22.819121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 334/651] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:04:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:04:22.827885 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] Creating event network-vif-plugged:e51e7474-f101-49dc-99e5-205ef1c34926 for instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 on hv-cinder-81566 Aug 11 10:04:22.830473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-95706b10-872e-480f-8c56-ec23d30ed758 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:22.832158 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-95706b10-872e-480f-8c56-ec23d30ed758 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:22.832884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-b81f3e5f-95bc-4ca5-9321-4ce6e791fd7d req-47667ffd-23e8-4c17-a4f2-59dd3426f827 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Aug 11 10:04:22.833850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 318/652] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:04:22.888764 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-95706b10-872e-480f-8c56-ec23d30ed758 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:22.896225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-95706b10-872e-480f-8c56-ec23d30ed758 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1237 microversion: 2.1 time: 0.069922 Aug 11 10:04:22.896798 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 335/653] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:22 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:23.760418 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:23.761145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:23.767238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:23.767712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:23.768134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:23.768814 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:23.769291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:23.769756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:23.902738 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:23.910121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc00c562-8d2d-499e-a324-d5f9b0b2b45a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.154431 Aug 11 10:04:23.910687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 319/654] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:23 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:23.916092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:23.916693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:23.923705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:23.924183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:23.924612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:23.925323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:23.925774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:23.926193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:23.986602 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:23.994505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ee1a1e14-a5ef-4e39-b4a9-6bca71e7888c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1241 microversion: 2.1 time: 0.082167 Aug 11 10:04:23.995068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 336/655] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:23 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:24.930854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:24.931540 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:24.939522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:24.940011 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:24.940447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:24.941170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:24.941625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:24.942050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:25.015513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:25.016111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:25.023101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:25.023580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:25.024000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:25.024799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:25.025271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:25.025692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:25.097932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:25.101179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:25.105637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-43f26e1e-e90a-45b7-a94f-b6e6cc432f1f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1233 microversion: 2.1 time: 0.093988 Aug 11 10:04:25.106487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 337/656] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:25 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:25.108466 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5f99aa03-b2d4-4fd1-a70b-870114e5f506 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1366 microversion: 2.1 time: 0.181620 Aug 11 10:04:25.109040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 320/657] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:24 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:26.126371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:26.126982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:26.129133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:26.129817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:26.133934 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.134420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.139017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.139017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.139017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.139290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.139399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.139477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.139477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.139477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.139477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.139740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.224652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:26.232137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-94225244-750a-4d4c-b45f-2070aa59ac39 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1289 microversion: 2.1 time: 0.109690 Aug 11 10:04:26.232707 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 338/658] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:26 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:26.292273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:26.299738 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b766043b-82fb-481f-9eb2-2a7509151dde tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1556 microversion: 2.1 time: 0.174672 Aug 11 10:04:26.300305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 321/659] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:26 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:26.319852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:26.320332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:26.326197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.326668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.327091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.327760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:26.328232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:26.328644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:26.405693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9b67642a-ddb8-4414-b4a5-9b89f780e6e0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089782 Aug 11 10:04:26.406399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 339/660] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:04:26 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:27.252112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:27.252743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:27.260239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:27.262322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:27.262322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:27.262322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:27.262322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:27.262748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:27.341147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:27.348834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b48d905c-3b3e-4e6f-8281-9fa6dbca062c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1297 microversion: 2.1 time: 0.100443 Aug 11 10:04:27.349440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 322/661] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:27 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:27.990107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce8ed1-33bd-4a45-8348-edc91b8fb137", "tag": "e51e7474-f101-49dc-99e5-205ef1c34926"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:28.001124 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:28.001948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:28.002632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:28.015493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] Creating event network-changed:e51e7474-f101-49dc-99e5-205ef1c34926 for instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 on hv-cinder-81566 Aug 11 10:04:28.021582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-008f0a7b-dd48-4b5a-9682-0a6405bdc787 req-f02ffb59-aecf-475d-baeb-07c89b4083cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Aug 11 10:04:28.022836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 340/662] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:28.370828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:28.371579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:28.378079 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:28.378961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:28.379075 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:28.381285 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:28.381758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:28.382193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:28.599266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:28.606976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-28ad2f93-aa9c-40c3-aae3-3320f3aafdea tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.240537 Aug 11 10:04:28.608169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 323/663] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:28 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:29.631248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:29.632026 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:29.638599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:29.639070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:29.639495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:29.640175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:29.640621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:29.641054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:29.769401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:29.776927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-48058398-b9cc-4e36-a2b9-fc3e6dfaf206 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.149943 Aug 11 10:04:29.777502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 341/664] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:29 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:30.798090 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:30.798704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:30.805777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:30.806272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:30.806714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:30.807752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:30.807949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:30.808381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:31.001247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:31.007898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-28fd6fe5-3db3-4cce-ac5a-2e948dac29f6 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.213864 Aug 11 10:04:31.008471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 324/665] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:30 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:32.031619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:32.034128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:32.038456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:32.038932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:32.039357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:32.040042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:32.040489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:32.040901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:32.247695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:32.255449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ebd7dcc3-0408-4223-9d39-09d23edbb1dd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.227474 Aug 11 10:04:32.256017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 342/666] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:32 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:32.359637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a98817-fde9-4929-a63a-62e85d8d94f5", "tag": "e9d81aa8-69b7-4779-a961-f10861b28c28"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:32.365561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:32.370849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:32.371425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:32.371861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:32.385530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] Creating event network-changed:e9d81aa8-69b7-4779-a961-f10861b28c28 for instance 53a98817-fde9-4929-a63a-62e85d8d94f5 on hv-cinder-81566 Aug 11 10:04:32.390509 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-5d0cf9ec-71e8-4e35-ba9b-284ec2de47af req-5ca4cb77-150d-473f-be70-bc5480c4c3fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035316 Aug 11 10:04:32.391297 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 325/667] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:33.276374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:33.276972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:33.278909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:33.279627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=12 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:33.284765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:33.285276 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:33.290381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:33.290381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:33.290381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:33.290381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:33.466890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:33.474682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2e9c9d4d-b0df-48c6-8a51-5e321df6642a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.202133 Aug 11 10:04:33.475274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 343/668] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:33 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:34.496866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:34.497480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:34.504699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:34.505209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:34.505642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:34.506326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:34.506777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:34.507194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:34.688703 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:34.696849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a2f7b2d1-adee-4eda-b741-7a41adb8410f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.204766 Aug 11 10:04:34.697451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 326/669] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:34 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:35.717706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:35.718333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:35.725446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:35.725926 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:35.726358 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:35.727086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:35.727535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:35.727979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:35.861736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:35.869207 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d05f0b3a-630e-427a-8dd8-287d223e4460 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.155752 Aug 11 10:04:35.869773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 344/670] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:35 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:36.889884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:36.890486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:36.897560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:36.898117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:36.898567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:36.899246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:36.899697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:36.900114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:37.031007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:37.038515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3bdb4b4a-ad72-4351-9437-83ea03e03dbb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.152592 Aug 11 10:04:37.039074 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 327/671] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:36 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:38.058826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:38.059431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:38.065920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:38.066403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:38.066871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:38.067559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:38.068007 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:38.068430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:38.199222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:38.206759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8ef7aea3-9f8b-4859-a86c-a829fc318169 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.151793 Aug 11 10:04:38.208025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 345/672] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:38 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:39.228034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:39.228645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:39.235033 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:39.235565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:39.235988 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:39.236696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:39.237186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:39.237621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:39.376964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:39.385324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3d847796-fbe5-4be4-bfa2-c7cc406ea243 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.161150 Aug 11 10:04:39.385830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 328/673] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:39 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:40.052858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:40.053557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:40.060093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:40.060576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:40.061265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:40.061992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:40.062410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:40.062832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:40.327896 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lazy-loading 'services' on Instance uuid e84d407a-ac5d-44fe-b83b-38c3dd58234b {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:04:40.409688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:40.410726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:40.418278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:40.418771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:40.419199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:40.419889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:40.420425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:40.422147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:40.529030 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9a7de189-57e1-480e-9e9e-ac0373bc2dbf tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b/os-volume_attachments/74fb2a19-d899-43bb-a9fa-985840800197" status: 202 len: 0 microversion: 2.1 time: 0.480076 Aug 11 10:04:40.533581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 346/674] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:04:40 2022] DELETE /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b/os-volume_attachments/74fb2a19-d899-43bb-a9fa-985840800197 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:04:40.575382 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:40.579551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:40.584853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7b55c9c6-082c-4a54-9428-299c69d17dff tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.180427 Aug 11 10:04:40.585589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 329/675] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:40 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:41.420619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a98817-fde9-4929-a63a-62e85d8d94f5", "name": "network-vif-plugged", "status": "completed", "tag": "e9d81aa8-69b7-4779-a961-f10861b28c28"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:41.430597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:41.431060 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:41.431506 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:41.443007 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] Creating event network-vif-plugged:e9d81aa8-69b7-4779-a961-f10861b28c28 for instance 53a98817-fde9-4929-a63a-62e85d8d94f5 on hv-cinder-81566 Aug 11 10:04:41.447633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-78cd43bc-b8fd-4194-8db5-6e846f26c243 req-e38847ab-3223-45b3-a5d5-492c88b7cf42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Aug 11 10:04:41.448216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 347/676] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:41.609607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:41.609607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:41.615627 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:41.616114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:41.616549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:41.617279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:41.617736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:41.618187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:41.751771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:41.759378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-08407b1f-9cc3-4ce7-9699-220ccd34459a tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.157238 Aug 11 10:04:41.759942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 330/677] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:41 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:42.718689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:42.719268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:42.725629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:42.726129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:42.726567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:42.727249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:42.727702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:42.728123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:42.752788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:04:42.779880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:42.780490 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:42.786790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:42.787375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:42.787806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:42.788519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:42.788967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:42.789403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:42.889443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:42.922989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:42.931178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-149c422a-1dc9-429d-99bf-fc303f6b6d8e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1363 microversion: 2.1 time: 0.155321 Aug 11 10:04:42.931740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 331/678] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:42 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:43.077769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e14ef8f3-e150-40fc-bac6-738e8cf17ba5 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 204 len: 0 microversion: 2.1 time: 0.363652 Aug 11 10:04:43.078351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 348/679] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:04:42 2022] DELETE /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:04:43.086425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:43.087042 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:43.093280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:43.093766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:43.094202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:43.096188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:43.096188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:43.096188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:43.227429 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:43.234835 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1140fa70-73a9-4b74-99c1-af00097149e1 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1512 microversion: 2.1 time: 0.152222 Aug 11 10:04:43.235403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 332/680] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:43 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:44.003680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:44.004379 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:44.010874 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.011352 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.011782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.012466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.012918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.013368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.143113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:44.150753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-19126af4-4948-4b6f-a736-6fa3a570f9cb tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1550 microversion: 2.1 time: 0.202862 Aug 11 10:04:44.151317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 349/681] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:43 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1550 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:44.170884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:44.171367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:44.178572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.179058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.179498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.180193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.180685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.181146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.256293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:44.256802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:44.261948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a01979c7-f570-4a05-a8e0-70c90909c52f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094858 Aug 11 10:04:44.262534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 333/682] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:04:44 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:44.263136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.263703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.264141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.264862 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:44.265338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:44.265759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:44.538452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:44.546042 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-130dfdff-75f5-4011-97cc-e820cbded27d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1512 microversion: 2.1 time: 0.294236 Aug 11 10:04:44.546622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 350/683] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:44 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:04:45.306757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a98817-fde9-4929-a63a-62e85d8d94f5", "tag": "e9d81aa8-69b7-4779-a961-f10861b28c28"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:45.315906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:45.316448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:45.316939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:45.328442 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] Creating event network-changed:e9d81aa8-69b7-4779-a961-f10861b28c28 for instance 53a98817-fde9-4929-a63a-62e85d8d94f5 on hv-cinder-81566 Aug 11 10:04:45.334339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-1b010be7-5f93-44ab-b4ea-6756ef256cab req-b084b3e3-d9bd-48f9-8f68-3f09b5bda01a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Aug 11 10:04:45.334941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 334/684] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:04:45.567349 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:45.568629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:45.575088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:45.575572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:45.576002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:45.576693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:45.577176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:45.577603 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:45.709210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:45.717061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-042eb57b-476b-45a3-86af-358aeef9c957 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1512 microversion: 2.1 time: 0.153658 Aug 11 10:04:45.717644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 351/685] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:45 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:46.738430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:46.739210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:46.746302 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:46.746796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:46.747235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:46.747936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:46.748393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:46.748816 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:47.303750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:47.311148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-91b1c67b-4daf-4e57-a980-932113bf601d tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1512 microversion: 2.1 time: 0.577516 Aug 11 10:04:47.311925 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 335/686] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:46 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:47.907807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84d407a-ac5d-44fe-b83b-38c3dd58234b", "name": "network-vif-deleted", "tag": "d5b385be-5584-4b78-bb69-60e0a2c29b24"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:04:47.916022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:47.923309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:47.923309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:47.923309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:47.933594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] Creating event network-vif-deleted:d5b385be-5584-4b78-bb69-60e0a2c29b24 for instance e84d407a-ac5d-44fe-b83b-38c3dd58234b on hv-cinder-81566 Aug 11 10:04:47.938420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-cd41dfcc-948f-4457-9703-d6f8c522e13e req-73a194a1-cfc2-4472-8f02-fd94a5e71e03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Aug 11 10:04:47.946060 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 352/687] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:04:48.332487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:48.334416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:48.344574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:48.344574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:48.344574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:48.344574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:48.344990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:48.344990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:48.373657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:48.374140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:48.374562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:48.375009 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lazy-loading 'fault' on Instance uuid e84d407a-ac5d-44fe-b83b-38c3dd58234b {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:04:48.416087 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd4018e26564721a8c16db0e9d2e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2a37c402a64171aae8a8c90b89ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:04:48.423702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6f75bae4-7f87-4c6a-8a5a-b1b42c516404 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 200 len: 1308 microversion: 2.1 time: 0.095775 Aug 11 10:04:48.424334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 336/688] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:48 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:04:49.446834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:04:49.447436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] [instance: e84d407a-ac5d-44fe-b83b-38c3dd58234b] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:04:49.454145 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:49.454622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:49.455045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:49.455754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:04:49.456201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:04:49.456620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:04:49.470356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] HTTP exception thrown: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Request method failure captured: Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b HTTP/1.1 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NOXtIl1FP1heNnr6pqduiFJ142fY2mDFENhq1JtxgUZyQ2fkjJXugw7nvNNwxazjNmFcjraF6-drZPpCjyHQMC2I9gggO-WYYy2QXBcpb28iSiRKP3wxn3UF91hmftpusQcx23Wz_PMPclBX0skz9RqnA0coUEzBmRwo3q3Z96GMvM Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: dd2a37c402a64171aae8a8c90b89ce33 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:04:49.471956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dd2a37c402a64171aae8a8c90b89ce33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: dd2a37c402a64171aae8a8c90b89ce33 Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1710756576 Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesSnapshotTestJSON-1710756576-project Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: acd4018e26564721a8c16db0e9d2e0aa Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesSnapshotTestJSON-1710756576-project Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. Aug 11 10:04:49.473593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'e84d407a-ac5d-44fe-b83b-38c3dd58234b'} Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:04:49.474501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. Aug 11 10:04:49.475795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:04:49.476846 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] Returning 404 to user: Instance e84d407a-ac5d-44fe-b83b-38c3dd58234b could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:04:49.476846 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-39e11749-f7cc-4feb-8612-fed0aa47af15 tempest-VolumesSnapshotTestJSON-1710756576 tempest-VolumesSnapshotTestJSON-1710756576-project] 10.222.0.17 "GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b" status: 404 len: 111 microversion: 2.1 time: 0.032509 Aug 11 10:04:49.476846 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 353/689] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:04:49 2022] GET /compute/v2.1/servers/e84d407a-ac5d-44fe-b83b-38c3dd58234b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:00.361814 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:00.362368 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:00.364871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=25 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:00.365550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=38 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:00.370571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.375818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.375818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.375818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.375818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.376416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.402869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-636048ce-82bb-4dc2-b3c2-d2c6796c2097 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments/8b69d2d1-c520-4f9c-bf61-b8578576d575" status: 200 len: 194 microversion: 2.20 time: 0.045037 Aug 11 10:05:00.404667 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 337/690] 10.222.0.17 () {60 vars in 1454 bytes} [Thu Aug 11 10:05:00 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments/8b69d2d1-c520-4f9c-bf61-b8578576d575 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:05:00.409655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:00.410155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:00.412598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:00.418393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.418828 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.419244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.419941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.420421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.420837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.471996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:00.472487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:00.478901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.479391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.479830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.480526 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.481139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.487915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.503282 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'services' on Instance uuid 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:00.563475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'services' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:00.717653 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-882e0360-484a-4860-addb-bd7b667d28fb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments/bdbc952a-7052-4e68-8d09-0733c0ec5176" status: 202 len: 0 microversion: 2.1 time: 0.311989 Aug 11 10:05:00.718233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 354/691] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:05:00 2022] DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments/bdbc952a-7052-4e68-8d09-0733c0ec5176 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:00.727547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:00.729941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:00.736256 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.737461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.737461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.738083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.738540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.738965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.768181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6dd0b250-dd67-43a7-99f1-81c0a503eb95 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 11 10:05:00.768740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 355/692] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:00 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:00.786478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-162616a7-9410-41e9-9f58-cfcc647ec531 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments/8b69d2d1-c520-4f9c-bf61-b8578576d575" status: 202 len: 0 microversion: 2.20 time: 0.318605 Aug 11 10:05:00.792311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 338/693] 10.222.0.17 () {60 vars in 1457 bytes} [Thu Aug 11 10:05:00 2022] DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments/8b69d2d1-c520-4f9c-bf61-b8578576d575 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:05:00.799630 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:00.802344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:00.808869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.815138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.815138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.815138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:00.815138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:00.815588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:00.840567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-65c22c29-a579-47a3-a696-0156f0fde8bc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045018 Aug 11 10:05:00.841209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 356/694] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:05:00 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 10:05:01.782629 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:01.784912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:01.791665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:01.792147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:01.792574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:01.793272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:01.793722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:01.794139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:01.822864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-dc42c574-9c28-4e0b-acc3-51bfe2baa6ad tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Aug 11 10:05:01.823404 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 339/695] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:01 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:01.854595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:01.856822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:01.863204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:01.863630 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:01.864056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:01.865443 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:01.865973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:01.866392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:01.894191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-89d8a187-ea0b-4a21-b101-3bb728bc9e8d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 Aug 11 10:05:01.894740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 357/696] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:05:01 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:05:02.835402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:02.837572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:02.844143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:02.844628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:02.845090 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:02.845781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:02.846234 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:02.846654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:02.877929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0aeaa43d-b00b-4ef5-94fb-ad78dd1f7954 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Aug 11 10:05:02.878469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 340/697] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:02 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:02.906521 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:02.908672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:02.914996 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:02.915464 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:02.915888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:02.916556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:02.917036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:02.917457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:02.946736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-57bc35e0-1a4e-4a1c-83b1-e659658a2827 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044207 Aug 11 10:05:02.947346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 358/698] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:05:02 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:05:03.890762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:03.892786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:03.899608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:03.900085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:03.900541 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:03.901250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:03.901698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:03.902113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:03.930535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5a17667f-f4e5-40ea-a54b-bf167781ab4f tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Aug 11 10:05:03.931073 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 341/699] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:03 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:03.959939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:03.964013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:03.968676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:03.969222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:03.969655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:03.970399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:03.970850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:03.971266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:04.000786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8bc3e0ba-55c8-4f73-92b0-58af14dbcbaa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045639 Aug 11 10:05:04.001428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 359/700] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:05:03 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:05:04.943190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:04.945462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:04.956126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:04.956619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:04.957089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:04.957795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:04.958338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:04.959273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:04.990436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5885e6c1-15ab-4819-8822-9a086720c3e2 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051519 Aug 11 10:05:04.991007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 342/701] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:04 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:05.013997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:05.016830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:05.026271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.026848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.027570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.028539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.029080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.029604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.060337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5f077d47-a099-4557-9b57-f466475f7ae8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050411 Aug 11 10:05:05.060918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 360/702] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:05:05 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:05.124427 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:05.124915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:05.131492 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.134066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.134066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.134066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.134066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.134524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.157989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:05.415017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-709c627d-6302-4b72-aa1d-6def9ddc5f51 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 204 len: 0 microversion: 2.20 time: 0.294305 Aug 11 10:05:05.415537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 343/703] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Aug 11 10:05:05 2022] DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 10:05:05.423999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:05.424598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:05.431233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.431718 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.432288 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.433020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:05.433484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:05.433908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:05.564579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:05.572689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:05.574220 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:05.575368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4dd9084b-a734-4f4b-86e4-5feef966df5b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.155527 Aug 11 10:05:05.575929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 361/704] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:05 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:06.006615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:06.008871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:06.015335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:06.015822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:06.016252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:06.016941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:06.017424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:06.017842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:06.047937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7fcfdf6a-8152-4968-b252-e68c870a60c5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Aug 11 10:05:06.048518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 344/705] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:06 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:06.598568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:06.599261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:06.605657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:06.606128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:06.606599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:06.607276 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:06.607722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:06.608133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:06.744584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:06.753646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:06.755731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:06.760383 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b83a291f-7b53-4d4a-8a6b-ccf1484c10da tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.162295 Aug 11 10:05:06.760383 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 362/706] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:06 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:07.060454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:07.062637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:07.069378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:07.069866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:07.070295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:07.070980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:07.071431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:07.071856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:07.101515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-37d63e68-1a1e-4d3a-80d2-8e0af8c53d2a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Aug 11 10:05:07.102059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 345/707] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:07 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:07.781763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:07.782367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:07.789129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:07.789611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:07.790038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:07.790724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:07.791174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:07.791592 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:07.963201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:07.971611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:07.973146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:07.974550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8a46d6af-379d-4593-95fd-4947c32ed0ce tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1724 microversion: 2.20 time: 0.196711 Aug 11 10:05:07.975126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 363/708] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:07 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:08.113935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:08.116575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:08.123028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.123516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.123953 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.126528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.126528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.126528 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.155146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ea354ace-5a2e-4873-a1a6-3025f68795d6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045148 Aug 11 10:05:08.155774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 346/709] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:08 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 10:05:08.241799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:08.242377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:08.253552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.254076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.254511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.255827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.256419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.257397 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.282351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:08.366895 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8db01-c3f2-467f-afd3-83ee9197d23d", "name": "network-vif-deleted", "tag": "511a3636-af0e-4eab-9ad8-a6a005902b1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:08.383362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.384178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.385270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.404734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] Creating event network-vif-deleted:511a3636-af0e-4eab-9ad8-a6a005902b1c for instance c0a8db01-c3f2-467f-afd3-83ee9197d23d on hv-cinder-81566 Aug 11 10:05:08.411863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-1d0c6997-40bc-43f3-86e7-319137899c1d req-39ab030f-72ae-4d67-9e98-91bd7a770fb1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109600 Aug 11 10:05:08.424050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 347/710] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:08.615747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-28f8b3ed-5a98-4b25-90e5-d227dbc702b6 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 204 len: 0 microversion: 2.1 time: 0.377930 Aug 11 10:05:08.618522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 364/711] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:05:08 2022] DELETE /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:05:08.625868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:08.626572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:08.634172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.634617 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.635050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.635744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:08.636190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:08.636604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:08.770173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:08.778278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c70fa384-3e9f-45fa-8cac-118bf57f80ea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1687 microversion: 2.1 time: 0.156718 Aug 11 10:05:08.778839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 348/712] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:08 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:08.998337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:08.999192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:09.006594 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:09.007313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:09.007717 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:09.008490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:09.009034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:09.009566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:09.041708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:09.042100 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:09.042526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:09.042959 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'fault' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:09.085886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:09.094300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:09.095802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:09.097006 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2e4cedf3-de2b-42e3-b461-4740201e500f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1371 microversion: 2.20 time: 0.103161 Aug 11 10:05:09.097791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 365/713] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:08 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:09.798964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:09.799572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:09.806589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:09.807091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:09.807549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:09.808247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:09.808697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:09.809151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:09.939588 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:09.947646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7e71ce01-8d5a-4203-9630-c66a0ed29744 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1687 microversion: 2.1 time: 0.152601 Aug 11 10:05:09.948218 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 349/714] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:09 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:10.120715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:10.121458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:10.128280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:10.128834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:10.129371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:10.130970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:10.131458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:10.131941 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:10.163898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:10.164284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:10.164706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:10.165166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'fault' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:10.205917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:10.214639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:10.216113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:10.217519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5f37c238-80e8-43d0-9c33-194ecd9034aa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1371 microversion: 2.20 time: 0.101043 Aug 11 10:05:10.218104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 366/715] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:10 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:10.969634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:10.970231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:10.977314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:10.977819 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:10.978254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:10.978929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:10.979383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:10.979802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:11.115166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:11.122857 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-95fc4168-5121-43e1-971a-b67f1e8b4b81 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1687 microversion: 2.1 time: 0.157296 Aug 11 10:05:11.123417 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 350/716] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:10 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:11.241228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:11.241831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:11.248359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:11.248836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:11.249307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:11.250015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:11.250466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:11.250887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:11.269282 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:11.281902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:11.294474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:11.294474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:11.294474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'fault' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:11.328284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:11.336264 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:11.337837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:11.339030 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f6fb93e3-13bd-41ea-9a40-ec6494111bb6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1371 microversion: 2.20 time: 0.102437 Aug 11 10:05:11.339634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 367/717] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:11 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:12.143363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:12.143969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:12.151146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:12.151593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:12.152145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:12.152798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:12.153279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:12.160915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:12.285186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:12.290438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:12.293108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c429152c-20c0-46aa-8cb0-970450fbe034 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1687 microversion: 2.1 time: 0.153547 Aug 11 10:05:12.293676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 351/718] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:12 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:12.362262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:12.362776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:12.370110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:12.370580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:12.371006 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:12.371673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:12.372167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:12.372579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:12.404497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:12.404964 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:12.405419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:12.405854 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'fault' on Instance uuid c0a8db01-c3f2-467f-afd3-83ee9197d23d {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:12.449596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:12.457539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:12.459378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:12.460530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-33ec0ee7-fa3b-4cd4-b3d5-a1b8ef366237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 200 len: 1371 microversion: 2.20 time: 0.102643 Aug 11 10:05:12.461087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 368/719] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:12 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:05:13.314849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:13.315457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:13.323152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:13.323639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:13.324082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:13.324764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:13.325255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:13.329730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:13.395193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:13.403180 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1d02ff76-7469-44b9-9fbc-44e449e1d231 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1619 microversion: 2.1 time: 0.092341 Aug 11 10:05:13.403758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 352/720] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:13 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1619 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:13.485752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:13.486496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:13.493316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:13.493804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:13.494232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:13.494988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:13.495434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:13.495850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:13.513817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d HTTP/1.1 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:13.515419 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:05:13.516772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'c0a8db01-c3f2-467f-afd3-83ee9197d23d'} Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:13.521579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:05:13.524524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:13.526691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:13.526691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9e5b06fd-9eda-4b18-91b5-26eab89b7f15 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 404 len: 111 microversion: 2.20 time: 0.034928 Aug 11 10:05:13.526691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 369/721] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:13 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:05:13.526937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-474d9891-4f8d-4569-8a70-5ecacb7d5517 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '.version_select at 0x7f787c0bde50>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:13.617127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-474d9891-4f8d-4569-8a70-5ecacb7d5517 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955756928" status: 204 len: 0 microversion: 2.20 time: 0.094903 Aug 11 10:05:13.618069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 353/722] 10.222.0.17 () {60 vars in 1262 bytes} [Thu Aug 11 10:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955756928 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 10:05:13.823160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef", "name": "network-vif-deleted", "tag": "31bdd006-6d81-4209-ad05-810cc9592c4b"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:13.832812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:13.833319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:13.833745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:13.846371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] Creating event network-vif-deleted:31bdd006-6d81-4209-ad05-810cc9592c4b for instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef on hv-cinder-81566 Aug 11 10:05:13.852698 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-bc988891-b146-4d1f-b7f0-dff3b755cd85 req-21ab8651-62b7-4d66-b104-0208883c5f48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Aug 11 10:05:13.853679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 370/723] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:14.396175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4100ddbc-0f58-4b30-8c75-230d50afdff8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: .version_select at 0x7f787c0db700>, body: {"keypair": {"name": "tempest-keypair-1542616560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoOI7GCy4/hZiSG/z0Ub/Zo+cbnK2bDemiTZYrptu4bTlhye++TUmGAYJzODYhGmUBo+qb3erqz7HEEbC8cvSUTpvA4Z+pVkSFBv+zV2JEseo2si8J2icLsw6ZOiBzBVQ=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:14.412365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-4100ddbc-0f58-4b30-8c75-230d50afdff8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:05:14.416210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-4100ddbc-0f58-4b30-8c75-230d50afdff8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for user 6113630b377f40eda2f8994ae69633ab and project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:05:14.425197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:14.426170 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:14.434493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:14.435323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:14.435450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:14.436131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:14.436579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:14.436995 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:14.475618 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:14.476181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:14.476588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:14.477078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'fault' on Instance uuid 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:14.523274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:14.528084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4100ddbc-0f58-4b30-8c75-230d50afdff8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.136081 Aug 11 10:05:14.528702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 354/724] 10.222.0.17 () {62 vars in 1200 bytes} [Thu Aug 11 10:05:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 10:05:14.541389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-98728c60-2d59-4370-a9cc-f144f2d827ff tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 200 len: 1333 microversion: 2.1 time: 0.118529 Aug 11 10:05:14.541389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 371/725] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:14 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:14.876132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:14.876906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:14.884727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:14.890666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:14.890666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:14.890666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:14.890666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:14.891070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:14.925470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ea03b348-2375-4f40-9e79-d016872246c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/ips" status: 200 len: 150 microversion: 2.1 time: 0.132789 Aug 11 10:05:14.925930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 355/726] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:05:14 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/ips => generated 150 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:15.570225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:15.570225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:15.575388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:15.576005 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:15.576441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:15.577693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:15.578232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:15.578663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:15.599253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] HTTP exception thrown: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Request method failure captured: Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef HTTP/1.1 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMQjZw7kFhz9g7LEJQsP-iH5ffu3I5awbWKeum2tTjFcw3C92yp9ymdQrILi1Kq0kmatFh7l0U91YYXlb0PpqBeC2XutFi7zptgUJkrKAnWo3607IitA058X3blz5YHT6Gbo8pnhbBDlUvY-ZXSxdNxrzfbTHo4fBh42H3Qm6AxpaM Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:15.601304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: c62f05ea732142c1af1c09dd23e7b9a3 Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. Aug 11 10:05:15.602914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef'} Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:15.603793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. Aug 11 10:05:15.605173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:15.606556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Returning 404 to user: Instance 7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:15.606556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-df156cc2-ca66-41f1-a21d-1851a942945d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef" status: 404 len: 111 microversion: 2.1 time: 0.048804 Aug 11 10:05:15.606556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 372/727] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:15 2022] GET /compute/v2.1/servers/7770f109-7d5e-4b26-bdf0-f7a8cc4c01ef => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:15.614586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5fa70d3b-9b48-4046-a43d-c931ee2b6514 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '.version_select at 0x7f787c111040>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:15.720081 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5fa70d3b-9b48-4046-a43d-c931ee2b6514 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149107346" status: 202 len: 0 microversion: 2.1 time: 0.110192 Aug 11 10:05:15.720876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 356/728] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Aug 11 10:05:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149107346 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:16.633788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c1070a0-ec3f-481a-ac68-b2a799070bad"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:16.636875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:16.643402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:16.643885 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:16.644315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:16.645026 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:16.645646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:16.646234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:17.106489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1081336092", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47526419-e702-4fc0-88b1-4a49c2ddc321"}], "security_groups": [{"name": "tempest-securitygroup--995302384"}], "key_name": "tempest-keypair-1542616560", "user_data": "}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:17.210464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] validate_networks() for [('47526419-e702-4fc0-88b1-4a49c2ddc321', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:05:17.527387 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2316bdd8-d386-46c2-819c-c4bddab31165 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898066 Aug 11 10:05:17.533346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 373/729] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:05:16 2022] POST /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:17.680348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:05:17.680831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:05:17.681448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:05:17.681954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:05:17.682430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:05:17.691503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:17.691984 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:17.692411 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:17.693159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:17.694237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:17.694654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:17.711382 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:05:17.715281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Getting quotas for user 6113630b377f40eda2f8994ae69633ab and project a8e4d096ae8d4610a665f2c3f197d9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:05:17.726537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:05:17.728998 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:05:17.875906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8124b379-b50a-4550-a253-2ef9502f0bb9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.774450 Aug 11 10:05:17.877852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 357/730] 10.222.0.17 () {62 vars in 1188 bytes} [Thu Aug 11 10:05:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 11 10:05:17.890457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:17.891516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:17.952393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:17.959983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:17.961549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:17.962654 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cbcd0c49-4019-4c26-84ec-fe663f33f6f2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1282 microversion: 2.20 time: 0.076519 Aug 11 10:05:17.963575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 374/731] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:17 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:18.985865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:18.986476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:18.994145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:18.994635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:18.995129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.001214 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:19.001214 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:19.001214 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.061679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:19.070875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:19.072420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:19.073564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e77744dd-aa86-4037-a1a5-258ccd94659a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1286 microversion: 2.20 time: 0.091724 Aug 11 10:05:19.074126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 358/732] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:18 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:19.112861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:19.113380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:19.121524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:19.122010 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:19.122450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.123128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:19.123582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:19.126879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.148756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:19.478090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-47b73973-8d3f-42ef-a6d7-eb67b89001cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 204 len: 0 microversion: 2.1 time: 0.368777 Aug 11 10:05:19.478783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 375/733] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:05:19 2022] DELETE /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:05:19.486974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:19.487580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:19.495720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:19.496394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:19.496849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.497845 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:19.498493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:19.499076 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:19.626689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:19.634055 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ac20979b-8ae3-49cd-bdce-ab5cc0fff8cb tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1508 microversion: 2.1 time: 0.150977 Aug 11 10:05:19.634615 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 359/734] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:19 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:20.096566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:20.097278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:20.103292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:20.103775 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:20.104210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:20.104886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:20.105357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:20.105778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:20.169292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:20.177131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:20.178705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:20.179796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-62072206-b481-4cbb-979b-f4d187041bb0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1334 microversion: 2.20 time: 0.087517 Aug 11 10:05:20.180354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 376/735] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:20 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:20.655143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:20.655746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:20.662166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:20.662684 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:20.663127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:20.663809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:20.664256 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:20.664672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:20.796678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:20.804987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4c826fb1-bb5f-40ee-a5b6-0da65014a371 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1508 microversion: 2.1 time: 0.153737 Aug 11 10:05:20.805569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 360/736] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:20 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:21.203058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:21.203653 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:21.210655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:21.211125 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:21.211548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:21.212229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:21.212679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:21.213122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:21.274289 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:21.282039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:21.283510 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:21.284589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-78aa70e0-484c-49e7-8b46-4bc6182ccfab tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1334 microversion: 2.20 time: 0.085672 Aug 11 10:05:21.285166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 377/737] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:21 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:21.826063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:21.827342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:21.833700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:21.834884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:21.835634 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:21.836332 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:21.836795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:21.837255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:22.088785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:22.104059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3d0bd9c1-bafa-442b-90f4-f5fb92fc272e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1508 microversion: 2.1 time: 0.281817 Aug 11 10:05:22.104649 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 361/738] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:21 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:22.307069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:22.308240 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:22.317645 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:22.318883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:22.319613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:22.320548 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:22.321844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:22.322472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:22.395987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646b1a35-413b-40a1-84d4-2534bee9e260", "name": "network-vif-deleted", "tag": "ec699f8d-e564-4579-b1ab-b720accb3d1c"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:22.406945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:22.407669 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:22.408267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:22.421205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] Creating event network-vif-deleted:ec699f8d-e564-4579-b1ab-b720accb3d1c for instance 646b1a35-413b-40a1-84d4-2534bee9e260 on hv-cinder-81566 Aug 11 10:05:22.429255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-4e6893e4-0b33-4eac-ab31-6c4a4224f0a9 req-a588cbfc-e767-4689-b629-da023abb6d4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038718 Aug 11 10:05:22.430025 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 362/739] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:22.441661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:22.453131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:22.454811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:22.456700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-43419326-4aa1-4f80-bd0e-1391ad86b5d1 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1340 microversion: 2.20 time: 0.154093 Aug 11 10:05:22.457680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 378/740] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:22 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:23.126533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:23.127401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:23.134348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:23.134976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:23.135496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:23.136283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:23.136800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:23.137311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:23.170245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:23.170900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:23.171347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:23.171791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lazy-loading 'fault' on Instance uuid 646b1a35-413b-40a1-84d4-2534bee9e260 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:23.235062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:23.244128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1b4ea9e8-e039-4d63-aa58-46622c666a6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 200 len: 1311 microversion: 2.1 time: 0.122379 Aug 11 10:05:23.245005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 363/741] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:23 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:23.479880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:23.480531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:23.486792 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:23.487258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:23.487684 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:23.488354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:23.488795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:23.489248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:23.712841 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:23.721768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:23.723852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:23.726141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d9c87b1e-c64b-48c1-9d74-4c3727c8ab10 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.250064 Aug 11 10:05:23.726969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 379/742] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:23 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:24.264638 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:24.265262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 646b1a35-413b-40a1-84d4-2534bee9e260] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:24.272082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.272576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.273031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.273902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.274354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.274812 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.288975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] HTTP exception thrown: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Request method failure captured: Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 HTTP/1.1 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMQjZw7kFhz9g7LEJQsP-iH5ffu3I5awbWKeum2tTjFcw3C92yp9ymdQrILi1Kq0kmatFh7l0U91YYXlb0PpqBeC2XutFi7zptgUJkrKAnWo3607IitA058X3blz5YHT6Gbo8pnhbBDlUvY-ZXSxdNxrzfbTHo4fBh42H3Qm6AxpaM Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:24.290651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: c62f05ea732142c1af1c09dd23e7b9a3 Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. Aug 11 10:05:24.292159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '646b1a35-413b-40a1-84d4-2534bee9e260'} Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:24.292987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. Aug 11 10:05:24.294153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:24.295164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Returning 404 to user: Instance 646b1a35-413b-40a1-84d4-2534bee9e260 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:24.295164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0af07cad-4ac5-42d5-a22e-e1e4a6ad85b5 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260" status: 404 len: 111 microversion: 2.1 time: 0.031353 Aug 11 10:05:24.295164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 364/743] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:24 2022] GET /compute/v2.1/servers/646b1a35-413b-40a1-84d4-2534bee9e260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:24.300949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:24.301486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:24.308573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.309185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.309622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.310306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.310758 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.311176 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.335728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:24.447829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:24.457209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.457684 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.458159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.469212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] Creating event network-changed:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:05:24.473957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-6874fa24-71f2-4ea1-b793-64877736000a req-af61b158-fd45-4567-8b00-c15b5d6ec54b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 Aug 11 10:05:24.474558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 365/744] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:24.640003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-df23e075-a5fc-49a9-b3a6-c6ec74a18c3e tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "DELETE /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 204 len: 0 microversion: 2.1 time: 0.341748 Aug 11 10:05:24.640709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 380/745] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:05:24 2022] DELETE /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:05:24.649480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:24.650184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:24.656410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.656889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.657363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.658046 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.658496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.658917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.749588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:24.750270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:24.756632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.757178 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.757601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.758279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:24.758746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:24.759159 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:24.777675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:24.790548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:24.798159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-57ee2580-bb0a-4185-a4c5-d493419c7f5d tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.153174 Aug 11 10:05:24.798734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 366/746] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:24 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:24.889153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:24.897365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:24.898838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:24.899935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2323df7d-d9f0-43d5-ba0a-c68c3af1bf41 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.154650 Aug 11 10:05:24.900547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 381/747] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:24 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:05:25.820207 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:25.822401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:25.824327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:25.827636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:25.828118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:25.828546 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:25.829262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:25.829710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:25.830155 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:25.923154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:25.923756 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:25.931462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:25.931989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:25.932519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:25.933255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:25.933710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:25.934131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:25.964689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:25.972658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-727ecce2-1228-47b2-84da-f8b31157ca6a tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.157024 Aug 11 10:05:25.973256 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 367/748] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:25 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:26.067403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:26.076122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:26.077597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:26.078706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d68d42e4-32e8-4ccc-9883-9ce2c6fe9139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.159427 Aug 11 10:05:26.079265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 382/749] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:25 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:05:26.995490 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:26.996266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:27.003165 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.003745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.004249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.004958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.005446 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.006134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.113362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:27.113362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:27.120046 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.120668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.121302 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.122353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.122733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.123154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.480102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:27.488019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-875c7e1f-1c7d-4a37-a473-87160c1e2487 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1523 microversion: 2.1 time: 0.497826 Aug 11 10:05:27.488584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 368/750] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:26 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:27.488708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:27.494083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c1070a0-ec3f-481a-ac68-b2a799070bad"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:27.496510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:27.497855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:27.499415 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:27.500812 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-156351e4-a265-4015-a9d5-0e2b3d1b3139 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.402521 Aug 11 10:05:27.501624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 383/751] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:27 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:27.503371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.504153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.504516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.505300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.506251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.506668 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.589062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: POST /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments HTTP/1.1 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 74 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:27.590790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {"volumeAttachment": {"volumeId": "8c1070a0-ec3f-481a-ac68-b2a799070bad"}} Aug 11 10:05:27.592367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'server_id': '2fce8ed1-33bd-4a45-8348-edc91b8fb137', 'body': {'volumeAttachment': {'volumeId': '8c1070a0-ec3f-481a-ac68-b2a799070bad'}}} Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:27.593163 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:27.594290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 400 to user: Invalid volume: volume 8c1070a0-ec3f-481a-ac68-b2a799070bad is already attached to instances: 2fce8ed1-33bd-4a45-8348-edc91b8fb137 {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d131637b-8432-400e-a54d-306293b6e864 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102679 Aug 11 10:05:27.596049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 369/752] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:05:27 2022] POST /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:05:27.659974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:27.660568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:27.667364 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.667848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.668307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.669002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.669480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.669905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.750384 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'services' on Instance uuid 2fce8ed1-33bd-4a45-8348-edc91b8fb137 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:27.900622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ab1218-d009-4e11-8813-b820e969974f", "name": "network-vif-deleted", "tag": "95a7c9a1-661d-4fc5-a036-2782d7ba88c6"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:27.905363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:27.906024 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=10 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:27.911246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.911719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.912394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.923439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] Creating event network-vif-deleted:95a7c9a1-661d-4fc5-a036-2782d7ba88c6 for instance 17ab1218-d009-4e11-8813-b820e969974f on hv-cinder-81566 Aug 11 10:05:27.928702 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-4aeed4b3-9bcd-42a7-a84c-1bf6db44320b req-7efb3a8c-4a0f-4025-a5df-5eb4163c0f48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Aug 11 10:05:27.929320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 370/753] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:27.956931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:27.974314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-69367141-4bfa-4b13-8f33-4ce88e57df0d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments/8c1070a0-ec3f-481a-ac68-b2a799070bad" status: 202 len: 0 microversion: 2.1 time: 0.318125 Aug 11 10:05:27.974954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 384/754] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:05:27 2022] DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments/8c1070a0-ec3f-481a-ac68-b2a799070bad => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:27.983880 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:27.986095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:27.993461 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.993966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.994398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:27.995086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:27.995531 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:27.996085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:28.025808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1c10526c-80b6-47ac-9365-f9f0c005e287 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Aug 11 10:05:28.026361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 371/755] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:27 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:28.510841 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:28.511713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:28.518934 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:28.519421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:28.519851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:28.520943 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:28.521711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:28.522138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:28.527841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:28.527841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:28.533963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:28.534912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:28.535352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:28.536052 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:28.538498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:28.539184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:28.625680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f05ea732142c1af1c09dd23e7b9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fb7bc39c364a5fb80532cbd3b2f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:28.633929 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0102d509-7dee-43b5-aa70-436ce3fc0dea tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 200 len: 1307 microversion: 2.1 time: 0.128066 Aug 11 10:05:28.634506 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 385/756] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:28 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:28.697388 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:28.705334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:28.706839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:28.707937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-10fc7d2a-7673-40eb-ae17-b5d9838a23d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.186993 Aug 11 10:05:28.708497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 372/757] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:28 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:05:29.039125 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:29.041666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:29.047831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.052359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.052359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:29.052359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.052359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.053562 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:29.080890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9016335d-32e6-4ac1-8691-9917710ccf3a tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Aug 11 10:05:29.081490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 386/758] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:29 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:29.654354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:29.654970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] [instance: 17ab1218-d009-4e11-8813-b820e969974f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:29.661077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.661567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.661995 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:29.662679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.663123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.663540 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:29.678181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] HTTP exception thrown: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Request method failure captured: Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f HTTP/1.1 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMQjZw7kFhz9g7LEJQsP-iH5ffu3I5awbWKeum2tTjFcw3C92yp9ymdQrILi1Kq0kmatFh7l0U91YYXlb0PpqBeC2XutFi7zptgUJkrKAnWo3607IitA058X3blz5YHT6Gbo8pnhbBDlUvY-ZXSxdNxrzfbTHo4fBh42H3Qm6AxpaM Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:29.679841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75fb7bc39c364a5fb80532cbd3b2f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 75fb7bc39c364a5fb80532cbd3b2f654 Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1675687627 Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: c62f05ea732142c1af1c09dd23e7b9a3 Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1675687627-project Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. Aug 11 10:05:29.681628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '17ab1218-d009-4e11-8813-b820e969974f'} Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:29.682693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. Aug 11 10:05:29.684129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:29.685603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] Returning 404 to user: Instance 17ab1218-d009-4e11-8813-b820e969974f could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:29.685603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-16097c2e-0c3b-4784-8269-5a25f01cbad3 tempest-ServerRescueNegativeTestJSON-1675687627 tempest-ServerRescueNegativeTestJSON-1675687627-project] 10.222.0.17 "GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f" status: 404 len: 111 microversion: 2.1 time: 0.030974 Aug 11 10:05:29.685603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 373/759] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:29 2022] GET /compute/v2.1/servers/17ab1218-d009-4e11-8813-b820e969974f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:29.732139 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:29.733553 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:29.737441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:29.742825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.744402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.745179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:29.746184 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:29.746662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:29.747613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.015198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:30.023919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:30.025435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:30.026553 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f4331589-4e3f-4903-9ec5-4f5d80af3edb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.298880 Aug 11 10:05:30.027122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 387/760] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:29 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:05:30.095030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:30.097460 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:30.104173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.104741 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.105265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.106038 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.106671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.107189 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.138150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0a42e9e1-b9be-4403-ad9b-cd21564daceb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048634 Aug 11 10:05:30.144183 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 374/761] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:30 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:05:30.217892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:30.218769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:30.226039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.226836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.227348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.228113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.228789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.229395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.254364 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:30.524196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-89bd4c41-9c49-4334-8feb-1af088e4c3ce tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 204 len: 0 microversion: 2.1 time: 0.311182 Aug 11 10:05:30.525118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 388/762] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:05:30 2022] DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:05:30.533928 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:30.534835 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:30.541426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.541992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.542426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.543286 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:30.543815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:30.544324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:30.562368 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:30.739750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:30.747632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-212e3e57-ae5d-47d8-89cd-63020768e3bb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1681 microversion: 2.1 time: 0.217687 Aug 11 10:05:30.748209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 375/763] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:30 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:31.050380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:31.051141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:31.059570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:31.060141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:31.060813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:31.061536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:31.061986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:31.062401 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:31.480441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:31.488448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:31.490647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:31.491928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-682b2495-b9ac-4e6a-aa3f-57f91578c319 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.446328 Aug 11 10:05:31.507247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 389/764] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:31 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:31.770278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:31.770874 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:31.780531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:31.781474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:31.782465 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:31.783165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:31.783903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:31.784514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:31.836189 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "name": "network-vif-plugged", "status": "completed", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:31.852822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:31.853612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:31.854229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:31.874352 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] Creating event network-vif-plugged:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:05:31.879991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-ad694eb6-2c44-41ff-8e07-cf69c81369d4 req-a92e0d11-2010-4af7-98f0-4f9f7c8889a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197040 Aug 11 10:05:31.881381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 376/765] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:31.935043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:31.943292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-397f84fc-a425-4256-8fa7-0cd6d2ea4318 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1681 microversion: 2.1 time: 0.177345 Aug 11 10:05:31.944338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 390/766] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:31 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:32.046085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:32.047052 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:32.054355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.055043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.055475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:32.056367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.056981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.057460 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:32.082911 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-59cf0aaf-9790-413f-90f3-7a3ed40b6f87 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/ips" status: 200 len: 147 microversion: 2.1 time: 0.040880 Aug 11 10:05:32.083465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 377/767] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:05:32 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:32.514520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:32.515120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:32.522843 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.523360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.523786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:32.524504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.525002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.525446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:32.758064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:32.787534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:32.787534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:32.787534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6980cee7-a2cc-452a-b57f-d9adf53f91e5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.275627 Aug 11 10:05:32.792277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 391/768] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:32 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:32.965817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:32.966633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:32.973550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.974281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.974845 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:32.975848 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:32.976488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:32.977086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:33.067477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:33.077385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4014b2c2-6007-4fc3-96c5-1b50e83cc1a3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1613 microversion: 2.1 time: 0.115313 Aug 11 10:05:33.078271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 378/769] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:32 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:33.386366 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fce8ed1-33bd-4a45-8348-edc91b8fb137", "name": "network-vif-deleted", "tag": "e51e7474-f101-49dc-99e5-205ef1c34926"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:33.408452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:33.409248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:33.409863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:33.435078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] Creating event network-vif-deleted:e51e7474-f101-49dc-99e5-205ef1c34926 for instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 on hv-cinder-81566 Aug 11 10:05:33.435078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-c5606ff6-05c8-4818-bfba-047f7580fd95 req-eb627eb1-01a2-4b07-99e0-d9fdd16dd9b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048033 Aug 11 10:05:33.435078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 392/770] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:33.810861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:33.811688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:33.819392 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:33.820659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:33.821149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:33.821861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:33.822320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:33.822745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:33.840232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64f1e7d-3797-4b25-9bbe-e06c6178381d"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:33.845143 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:33.859860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:33.860741 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:33.861669 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:33.862690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:33.863338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:33.863952 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:34.025359 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:34.034448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:34.036459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:34.038719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5483aaf7-7dfd-4893-a8cd-f42df861923c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1407 microversion: 2.20 time: 0.231682 Aug 11 10:05:34.039864 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 379/771] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:33 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:34.100781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:34.101820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:34.108655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:34.109725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:34.110337 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:34.111265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:34.112062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:34.113060 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:34.182287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:34.194954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3e66e5eb-aed1-42e9-ab06-86eca8728e54 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 200 len: 1325 microversion: 2.1 time: 0.098906 Aug 11 10:05:34.195709 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 380/772] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:34 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:34.937679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-320efa7b-ecd0-4395-9045-c04a8cd62184 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.102365 Aug 11 10:05:34.949721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 393/773] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:05:33 2022] POST /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:35.066378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:35.066993 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:35.074865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.075355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.075794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.076497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.076959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.077604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.216581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:35.217563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:35.220553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:35.223913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.225487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.225930 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.226636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.227091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.227517 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.229184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:35.230763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:35.231989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a51c2470-6408-48c3-bb8e-942b9140311b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1599 microversion: 2.20 time: 0.169503 Aug 11 10:05:35.232628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 381/774] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:05:35 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:05:35.241958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 HTTP/1.1 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:35.243588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:05:35.245150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '2fce8ed1-33bd-4a45-8348-edc91b8fb137'} Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:35.246122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:05:35.247544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:35.248819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:35.248819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0f3be23c-ae18-4edc-960d-edd99846387f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 404 len: 111 microversion: 2.1 time: 0.032773 Aug 11 10:05:35.248819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 394/775] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:35 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:05:35.254372 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-829e0f83-3ceb-41d5-84e0-21bc474c1fea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '.version_select at 0x7f787cdfd3a0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:35.254731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:35.255213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:35.262157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.262631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.263058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.263741 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:35.264185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:35.264665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:35.345846 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bd6f2348-bb9c-4d11-a446-885a2f58513c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094851 Aug 11 10:05:35.346775 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 395/776] 10.222.0.17 () {60 vars in 1316 bytes} [Thu Aug 11 10:05:35 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:05:35.358620 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-829e0f83-3ceb-41d5-84e0-21bc474c1fea tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-613314074" status: 202 len: 0 microversion: 2.1 time: 0.108020 Aug 11 10:05:35.359195 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 382/777] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Aug 11 10:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-613314074 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:36.204991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cedfb22d-9f48-41e9-ba87-9a9d0fb7745d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: .version_select at 0x7f787c0b1d30>, body: {"keypair": {"name": "tempest-keypair-1026562322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvh9vCo7K6yRxi0SKZ0+vdgvsZQ+Rm4/AGulyDhpJGSqDQ0hBfzmazfkhraL+g/ywmd6T/D+ODymMxH90nRuvFfZrY1U/JE0Vc65JHGkPS/NU6bTwFI7slwsZ3mVISAoQ=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:36.224199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-cedfb22d-9f48-41e9-ba87-9a9d0fb7745d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:05:36.228739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-cedfb22d-9f48-41e9-ba87-9a9d0fb7745d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:05:36.257296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f6b82eba-ac46-4a20-ada8-5333de737231 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Action: 'create', calling method: .version_select at 0x7f787c0ee700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1060775767", "metadata": {"Type": "work"}}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f6b82eba-ac46-4a20-ada8-5333de737231 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 122 Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:36.267206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1060775767", "metadata": {"Type": "work"}}} Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 10:05:36.274412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1060775767', 'metadata': {'Type': 'work'}}}} Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise error Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi '#$%' Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.275431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 10:05:36.276807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 10:05:36.278077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 10:05:36.278077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.278077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f6b82eba-ac46-4a20-ada8-5333de737231 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.278077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f6b82eba-ac46-4a20-ada8-5333de737231 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149360 Aug 11 10:05:36.278077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 396/778] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Aug 11 10:05:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:05:36.282158 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-feeeb6a9-a007-41ba-9e33-395964b2c265 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Action: 'create', calling method: .version_select at 0x7f787c147160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1387672728", "metadata": {"Type": "work"}}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-feeeb6a9-a007-41ba-9e33-395964b2c265 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 120 Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:36.285754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1387672728", "metadata": {"Type": "work"}}} Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 10:05:36.288115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1387672728', 'metadata': {'Type': 'work'}}}} Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise error Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi '0' Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.289141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 10:05:36.292255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 10:05:36.294022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 10:05:36.294022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.294022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-feeeb6a9-a007-41ba-9e33-395964b2c265 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.294022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-feeeb6a9-a007-41ba-9e33-395964b2c265 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012675 Aug 11 10:05:36.294022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 397/779] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Aug 11 10:05:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 10:05:36.294431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cedfb22d-9f48-41e9-ba87-9a9d0fb7745d tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091956 Aug 11 10:05:36.294831 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 383/780] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:05:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:36.300908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-dd9a781e-29c8-4ee0-9ee2-73f2139e4809 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Action: 'create', calling method: .version_select at 0x7f787c10b040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1645951909", "metadata": {"Type": "work"}}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-dd9a781e-29c8-4ee0-9ee2-73f2139e4809 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 119 Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:36.304760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1645951909", "metadata": {"Type": "work"}}} Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 10:05:36.306085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1645951909', 'metadata': {'Type': 'work'}}}} Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise error Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi '' Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.307254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 10:05:36.308890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 10:05:36.310050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 10:05:36.310050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.310050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-dd9a781e-29c8-4ee0-9ee2-73f2139e4809 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.310050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-dd9a781e-29c8-4ee0-9ee2-73f2139e4809 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010252 Aug 11 10:05:36.310050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 398/781] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Aug 11 10:05:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:05:36.318049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7dc845a2-37b4-4087-9251-c624dbe29882 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Calling method '.version_select at 0x7f787c0e5430>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:36.347994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-7dc845a2-37b4-4087-9251-c624dbe29882 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] HTTP exception thrown: Volume tempest-invalid-576576594 could not be found. Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7dc845a2-37b4-4087-9251-c624dbe29882 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-576576594 HTTP/1.1 Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:36.351275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Volume tempest-invalid-576576594 could not be found. Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'tempest-invalid-576576594'} Aug 11 10:05:36.360070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-576576594 could not be found. (HTTP 404) (Request-ID: req-95f2385d-f533-4b6a-8f1a-a360c9a8ed5c) Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.361112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 10:05:36.362558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-576576594 could not be found. Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:36.363936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-576576594 could not be found. Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-576576594 could not be found. Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7dc845a2-37b4-4087-9251-c624dbe29882 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 404 to user: Volume tempest-invalid-576576594 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7dc845a2-37b4-4087-9251-c624dbe29882 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-576576594" status: 404 len: 98 microversion: 2.1 time: 0.038839 Aug 11 10:05:36.365733 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 384/782] 10.222.0.17 () {58 vars in 1215 bytes} [Thu Aug 11 10:05:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-576576594 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 11 10:05:36.368828 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-02796ba5-888b-41db-8dd3-f8c4e249b2e4 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010283 Aug 11 10:05:36.369355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 399/783] 10.222.0.17 () {58 vars in 1140 bytes} [Thu Aug 11 10:05:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 10:05:36.378226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6c0478eb-411b-4e32-a3d2-68a49dbe4aac tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003904 Aug 11 10:05:36.378723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 385/784] 10.222.0.17 () {58 vars in 1137 bytes} [Thu Aug 11 10:05:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 10:05:36.387467 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f5685226-b1d7-48bc-b5a5-9020645c2080 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Calling method '.version_select at 0x7f787c147280>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:36.417417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-f5685226-b1d7-48bc-b5a5-9020645c2080 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] HTTP exception thrown: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f5685226-b1d7-48bc-b5a5-9020645c2080 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/os-volumes/d7cbd20e-c6b6-4756-9700-2e936458fdf5 HTTP/1.1 Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:05:36.420070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'd7cbd20e-c6b6-4756-9700-2e936458fdf5'} Aug 11 10:05:36.421417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. (HTTP 404) (Request-ID: req-f36f90a6-95c8-45f0-be5c-2b8d06ea28ce) Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.422456 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 10:05:36.423766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 10:05:36.425083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f5685226-b1d7-48bc-b5a5-9020645c2080 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 404 to user: Volume d7cbd20e-c6b6-4756-9700-2e936458fdf5 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.426466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f5685226-b1d7-48bc-b5a5-9020645c2080 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d7cbd20e-c6b6-4756-9700-2e936458fdf5" status: 404 len: 109 microversion: 2.1 time: 0.037770 Aug 11 10:05:36.433122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 400/785] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:05:36 2022] DELETE /compute/v2.1/os-volumes/d7cbd20e-c6b6-4756-9700-2e936458fdf5 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:36.434767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-49a97065-6e0b-497d-8b59-db101e7aba34 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Calling method '.version_select at 0x7f787c0b1550>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-49a97065-6e0b-497d-8b59-db101e7aba34 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] HTTP exception thrown: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-49a97065-6e0b-497d-8b59-db101e7aba34 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Request method failure captured: Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/os-volumes/169e2bb2-1c85-47e0-a7c5-2c5b29162609 HTTP/1.1 Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NRw_HXwnxGQUUcsTl1gMeOq1f7qZNwVsqoc49QrQNHT1YJFVbWL2P4-f8XHa-_DMBUHy0x4c-cSfxzBAASIGdppIMaAzwn_40gd-ATJEbQySAls4D8W1S5bo7z1iJCtfkIxD6tckqiiy_94yzQ2jvjBNeDBEkXFiwEpzSHQb6BYeDI Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:36.470943 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a3d8d6884d84837aadcee25361207cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 3a3d8d6884d84837aadcee25361207cd Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesNegativeTest-1917967468 Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: d576231a16264588b9f183a6035bb3ae Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesNegativeTest-1917967468-project Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '169e2bb2-1c85-47e0-a7c5-2c5b29162609'} Aug 11 10:05:36.472636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. (HTTP 404) (Request-ID: req-ff9b9a31-d32b-435e-9556-aa3055673343) Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.473562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 10:05:36.474822 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 10:05:36.476122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-49a97065-6e0b-497d-8b59-db101e7aba34 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] Returning 404 to user: Volume 169e2bb2-1c85-47e0-a7c5-2c5b29162609 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-49a97065-6e0b-497d-8b59-db101e7aba34 tempest-VolumesNegativeTest-1917967468 tempest-VolumesNegativeTest-1917967468-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/169e2bb2-1c85-47e0-a7c5-2c5b29162609" status: 404 len: 109 microversion: 2.1 time: 0.039443 Aug 11 10:05:36.477750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 386/786] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:05:36 2022] GET /compute/v2.1/os-volumes/169e2bb2-1c85-47e0-a7c5-2c5b29162609 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:05:36.739036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:36.748978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:36.749484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:36.749930 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:36.753825 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:36.763527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] Creating event network-changed:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:05:36.768389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-1de7af26-2f57-4270-9b66-cdabcd97a44b req-685270c6-6831-4af1-a892-61a2cf7bc03a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098960 Aug 11 10:05:36.768998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 401/787] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:38.942419 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1752392706", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d20a0340-e393-4428-8a14-1335a616fcac"}], "security_groups": [{"name": "tempest-securitygroup--779874873"}], "key_name": "tempest-keypair-1026562322", "user_data": "}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:39.045823 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] validate_networks() for [('d20a0340-e393-4428-8a14-1335a616fcac', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:05:39.425098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:05:39.425244 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:05:39.425589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:05:39.426025 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:05:39.426431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:05:39.435644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:39.436117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:39.436541 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:39.437288 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:39.437735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:39.438154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:39.455749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:05:39.459445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Getting quotas for user 28b31650305943b498f02c882baa0144 and project c22d997be9cb4bbb8235eda18fa92074. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:05:39.471107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:05:39.473389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:05:39.635428 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e97f1c6f-9b03-4593-8b34-f659d682c2c3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698371 Aug 11 10:05:39.636513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 387/788] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:05:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:05:39.648947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c4cfd755-dcfe-4b18-a3fe-5e58c7838a8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:39.651948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c4cfd755-dcfe-4b18-a3fe-5e58c7838a8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:39.721287 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c4cfd755-dcfe-4b18-a3fe-5e58c7838a8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:39.728927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c4cfd755-dcfe-4b18-a3fe-5e58c7838a8c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1242 microversion: 2.1 time: 0.085600 Aug 11 10:05:39.729534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 402/789] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:39 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:40.750876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:40.751628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:40.759558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:40.760206 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:40.760645 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:40.761405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:40.762046 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:40.762499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:40.835826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:40.844188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f1e32aad-c64f-4e49-81d0-53c7e0a7b1e4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1238 microversion: 2.1 time: 0.097909 Aug 11 10:05:40.844871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 388/790] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:40 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:41.866965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:41.867577 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:41.874788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:41.875304 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:41.875745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:41.876432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:41.876887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:41.877334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:41.943968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:41.951397 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c89d37cb-5ae6-4463-91a4-fc32ce6c641e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1302 microversion: 2.1 time: 0.088923 Aug 11 10:05:41.951989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 403/791] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:41 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:42.535281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:42.538154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:42.546980 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.547853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.548610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:42.550577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.551234 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.551841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:42.589916 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-78547cd9-6e7d-452c-9068-13e94f7822a5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058353 Aug 11 10:05:42.596421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 389/792] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:42 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:42.602059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:42.602767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:42.608696 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.609201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.609638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:42.610328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.610778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.611190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:42.643028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bfbcc104-d24a-4fb6-b8d2-9000b170e59b tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d" status: 200 len: 194 microversion: 2.1 time: 0.045082 Aug 11 10:05:42.648909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 404/793] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Aug 11 10:05:42 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:42.973118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:42.979540 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:42.980632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.981332 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.981915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:42.982777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:42.983410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:42.983982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:43.066912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:43.075478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cc6dfe67-a10e-4c5e-8f13-6e94dbb49de1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1300 microversion: 2.1 time: 0.106499 Aug 11 10:05:43.076049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 390/794] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:42 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:44.097169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:44.097877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:44.105047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:44.105533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:44.105962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:44.106765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:44.107221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:44.107640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:44.273925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:44.282970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c6bd0b7c-ca61-428e-842d-cf9acdadb1d5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.190354 Aug 11 10:05:44.283536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 405/795] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:44 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:44.351038 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7d34b9-1317-48cc-9d8c-f1147f5fd488", "tag": "4920c93f-63bb-4886-bee4-b0117a541d6e"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:44.363904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:44.364914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:44.365443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:44.385912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] Creating event network-changed:4920c93f-63bb-4886-bee4-b0117a541d6e for instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 on hv-cinder-81566 Aug 11 10:05:44.392749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-2937f6ad-ee35-49d1-b84b-56b7120d9de6 req-0a62848f-9a2b-4830-850d-44f1c9b4a326 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046161 Aug 11 10:05:44.393378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 391/796] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:44.401753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e28648a-6594-4354-a3d7-be276e29aa5b"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:44.404181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:44.410196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:44.410676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:44.411322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:44.412266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:44.412725 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:44.413248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:45.270221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-855b0540-4ec3-44c7-97c2-dcea6f4fa6fd tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "POST /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872165 Aug 11 10:05:45.276685 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 406/797] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:05:44 2022] POST /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:45.305994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:45.306687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:45.315435 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:45.315965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:45.316340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:45.317063 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:45.318663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:45.318799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:45.651008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:45.661728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-88520c9d-c2bc-4973-983c-0602ee9dadec tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.359848 Aug 11 10:05:45.662971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 392/798] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:45 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:46.290829 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:46.291403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:46.298085 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.298558 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.298983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.299681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.300104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.300515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.325418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:05:46.620453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-93d57fe0-4fbb-4c99-be18-b3eb6b709bbf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 204 len: 0 microversion: 2.1 time: 0.333659 Aug 11 10:05:46.621065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 407/799] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:05:46 2022] DELETE /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:05:46.629480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:46.630765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:46.638126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.638607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.639037 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.639724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.640171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.640652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.685305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:46.686006 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:46.694259 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.694847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.698412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.698412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:46.698412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:46.698412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:46.824162 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:46.832531 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-57c68df6-bb09-4b09-bac8-df67c4e2a923 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1577 microversion: 2.1 time: 0.206930 Aug 11 10:05:46.833744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 393/800] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:46 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:46.875591 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:46.883281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f03038c6-f5d4-4a86-a73e-a70c2c625b05 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.203363 Aug 11 10:05:46.883839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 408/801] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:46 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:47.855098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:47.855704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:47.862224 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:47.862717 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:47.863507 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:47.864416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:47.864882 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:47.865347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:47.905706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:47.906318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:47.914136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:47.914633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:47.915068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:47.915768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:47.916221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:47.916640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:48.052729 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:48.063487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6f56e2de-e556-437c-8271-9caa11cd579d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1577 microversion: 2.1 time: 0.212282 Aug 11 10:05:48.065908 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 394/802] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:47 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:48.091133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:48.097320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c12a87a2-d94c-4183-b609-88c7ebe328c7 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.195348 Aug 11 10:05:48.098043 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 409/803] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:47 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:49.087409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:49.088222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:49.095052 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:49.095539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:49.095973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:49.097369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:49.097973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:49.098408 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:49.124740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:49.125852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:49.133492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:49.133983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:49.134447 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:49.136559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:49.136559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:49.136559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:49.206974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:49.210658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-267fe02e-aee9-4d3f-ac6f-0f5201d9bffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1510 microversion: 2.1 time: 0.127488 Aug 11 10:05:49.211271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 395/804] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:49 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1510 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:49.341752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:49.349524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-942fb9e9-3dc7-467e-84e4-7fd6992ee1ca tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.234304 Aug 11 10:05:49.350090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 410/805] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:49 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:49.494483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc4d305-287b-4a37-9d4d-99ceb3e3f720", "name": "network-vif-deleted", "tag": "13119f6c-980c-4766-a32c-a213e4198421"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:49.501895 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:49.506727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=10 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:49.509309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:49.509794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:49.510217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:49.526094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] Creating event network-vif-deleted:13119f6c-980c-4766-a32c-a213e4198421 for instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 on hv-cinder-81566 Aug 11 10:05:49.532038 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-fbd86dd7-de77-48ce-8011-1cd916f2b026 req-3c71ba1b-c136-4990-a175-1509d90d266a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043319 Aug 11 10:05:49.533077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 396/806] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:50.155972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7d34b9-1317-48cc-9d8c-f1147f5fd488", "name": "network-vif-plugged", "status": "completed", "tag": "4920c93f-63bb-4886-bee4-b0117a541d6e"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:50.160960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:50.166841 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.167382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.167871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.179497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] Creating event network-vif-plugged:4920c93f-63bb-4886-bee4-b0117a541d6e for instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 on hv-cinder-81566 Aug 11 10:05:50.188251 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-b915c091-23b5-4223-ae9a-d40765cf7d1b req-37a30883-7641-4910-b961-b761f7f3c2ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Aug 11 10:05:50.188723 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 411/807] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:50.232914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:50.233708 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:50.241672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.242152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.242581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.243270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.243724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.244146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.286841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.288382 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.288832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.289330 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lazy-loading 'fault' on Instance uuid 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:50.341030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:50.348781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b1bdb9ea-a949-4f95-a0e7-54b09da693e6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 200 len: 1230 microversion: 2.1 time: 0.120544 Aug 11 10:05:50.352008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 397/808] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:50 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:50.372392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:50.373280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:50.380069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.380551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.381075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.381916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:50.382372 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:50.382789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:50.524754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:50.532516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-469fc408-34c8-4955-a64a-45b81fe959b1 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.164451 Aug 11 10:05:50.533183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 412/809] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:50 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:51.371326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:51.371843 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:51.378216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:51.378698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:51.379129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:51.379814 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:51.380267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:51.380689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:51.394114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] HTTP exception thrown: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Request method failure captured: Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 HTTP/1.1 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NO5ibQ6Gbd4G8yGs2YA5YJX5vt-VUoxoj2z6UkgmqjCk090s3qKQfcIFOruZ1KlSY-FxESfkP95HHu9h9mEh_6gBtszfct0vWdEVK4egksQytPmbw6Tbi6_F8MVBmESZPVIBOr64U11tcISL1ZiVCTLcuz9veprY3F118K2qPx4nB4 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:05:51.395735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: ee81d8d9cf994df68a15afe5cb9673c4 Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:05:51.397747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '0bc4d305-287b-4a37-9d4d-99ceb3e3f720'} Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:05:51.398537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:05:51.399701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:05:51.400719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Returning 404 to user: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:05:51.400719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d39266e5-3c6f-4432-8832-138b547a3535 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 404 len: 111 microversion: 2.1 time: 0.030381 Aug 11 10:05:51.400719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 398/810] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:51 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:51.495486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-769394458", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1138903170", "security_groups": [{"name": "tempest-secgroup-smoke-671395048"}], "block_device_mapping_v2": [{"uuid": "a528f449-f9bc-432d-9096-7a9649d5062b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43181ee7-31a3-4e3c-b3f4-f4da182a8730"}]}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:51.554248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:51.555276 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:51.561210 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:51.561696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:51.562135 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:51.562828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:51.563456 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:51.563884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:51.619211 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] validate_networks() for [('43181ee7-31a3-4e3c-b3f4-f4da182a8730', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:05:52.020227 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:52.029413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-05336bb6-7ce4-40fd-b97b-c3e45df57d39 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1367 microversion: 2.1 time: 0.479095 Aug 11 10:05:52.030143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 399/811] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:51 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:52.376340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:05:52.376759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:05:52.377270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:05:52.377676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:05:52.378108 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:05:52.388635 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:52.389138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:52.389762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:52.390662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:52.391115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:52.391556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:52.410172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:05:52.414327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for user ee81d8d9cf994df68a15afe5cb9673c4 and project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:05:52.477306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:05:52.479480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a528f449-f9bc-432d-9096-7a9649d5062b',volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:05:52.908661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-097d9c3f-ea37-4163-9b66-befef5cae9b0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.417068 Aug 11 10:05:52.909748 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 413/812] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:05:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:05:52.920412 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e64b7434-98dd-44f5-b38c-1c3efd93432a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:52.921079 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e64b7434-98dd-44f5-b38c-1c3efd93432a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:52.990788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e64b7434-98dd-44f5-b38c-1c3efd93432a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:52.998769 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e64b7434-98dd-44f5-b38c-1c3efd93432a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1094 microversion: 2.1 time: 0.082116 Aug 11 10:05:52.999420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 400/813] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:52 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:53.049700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:53.050311 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:53.059811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.060303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.060736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.061504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.062129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.062561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.203146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:53.210921 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-365b8d39-3cf2-4509-8853-62e01b4978eb tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1557 microversion: 2.1 time: 0.165131 Aug 11 10:05:53.211605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 414/814] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:53 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:53.233040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:53.233802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:53.239784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.240214 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.240646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.241450 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.241904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.242329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.259247 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:53.324881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0639781c-086d-4523-bd9b-3a70d37baee8 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095860 Aug 11 10:05:53.326216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 401/815] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Aug 11 10:05:53 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:53.907455 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:53.909720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:53.916804 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.917963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.918396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.919086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:53.919530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:53.919945 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:53.954597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7dc8a0b0-2483-49ad-99c4-9606a5a3886c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051383 Aug 11 10:05:53.955319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 415/816] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:53 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:54.020513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:54.021179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:54.027990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.028468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.028893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.029604 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.030050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.030519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.098830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:54.099310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:54.105816 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:54.106395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.106880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.107313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.108134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.108579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.108992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.114677 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b292912f-47d9-4797-b694-7961d6bedbac tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1144 microversion: 2.1 time: 0.098508 Aug 11 10:05:54.115244 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 402/817] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:54 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:05:54.159870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9394400a-db77-4519-b1e1-b8190c7e09cf tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d" status: 200 len: 194 microversion: 2.1 time: 0.064965 Aug 11 10:05:54.160579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 416/818] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Aug 11 10:05:54 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:54.172093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:54.172716 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:54.178914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.179399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.179830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.180515 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.181279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.181730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.270973 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lazy-loading 'services' on Instance uuid 53a98817-fde9-4929-a63a-62e85d8d94f5 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:54.384253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7d34b9-1317-48cc-9d8c-f1147f5fd488", "tag": "4920c93f-63bb-4886-bee4-b0117a541d6e"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:54.393884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:54.394372 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:54.394786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:54.407123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] Creating event network-changed:4920c93f-63bb-4886-bee4-b0117a541d6e for instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 on hv-cinder-81566 Aug 11 10:05:54.412678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-f74a3e47-4fa4-4753-aae6-5a2d39f528e5 req-280f9be0-c6aa-4347-8d78-9d0707d8724c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Aug 11 10:05:54.413727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 417/819] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:54.558468 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-36b317d7-2f13-4361-adf5-d36f44a53f29 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d" status: 202 len: 0 microversion: 2.1 time: 0.390557 Aug 11 10:05:54.562815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 403/820] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:05:54 2022] DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/b64f1e7d-3797-4b25-9bbe-e06c6178381d => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:55.136998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:55.137659 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:55.143886 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:55.144365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:55.144796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:55.145522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:55.145968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:55.146386 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:55.164477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:55.211128 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:55.220268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d2caa8d1-a423-4fef-8159-dcb911f42f02 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1200 microversion: 2.1 time: 0.088536 Aug 11 10:05:55.220861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 418/821] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:55 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:56.243938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:56.245004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:56.249672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:56.253548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:56.254111 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:56.254618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:56.255521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:56.255978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:56.256504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:56.339609 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:56.347521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fd7312a4-9d9f-48f7-887b-853ed04ccce3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1210 microversion: 2.1 time: 0.109120 Aug 11 10:05:56.348371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 404/822] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:56 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:57.166974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:57.167479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:57.174281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.174760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.175185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.175861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.176311 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.176727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.205509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5f88079e-8f65-49f6-850b-0844671dbe41 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/4e28648a-6594-4354-a3d7-be276e29aa5b" status: 200 len: 194 microversion: 2.1 time: 0.043136 Aug 11 10:05:57.206088 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 419/823] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Aug 11 10:05:57 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/4e28648a-6594-4354-a3d7-be276e29aa5b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:05:57.218900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:57.219422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:57.225747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.226236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.226673 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.227361 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.227968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.228560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.331493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lazy-loading 'services' on Instance uuid 53a98817-fde9-4929-a63a-62e85d8d94f5 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:05:57.378201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:57.379173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:57.386997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.387728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.388319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.389391 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.391238 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.391683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.554306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:57.561978 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-30b35c47-a2f1-404a-b9f4-ccf0ec6dc6d7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1277 microversion: 2.1 time: 0.188363 Aug 11 10:05:57.562536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 420/824] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:57 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:57.598140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-712d27d0-5e9a-42df-8491-889b0b7ad06e tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/4e28648a-6594-4354-a3d7-be276e29aa5b" status: 202 len: 0 microversion: 2.1 time: 0.384752 Aug 11 10:05:57.598974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 405/825] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:05:57 2022] DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments/4e28648a-6594-4354-a3d7-be276e29aa5b => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:05:57.624620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f34ff7a-4a51-4395-9343-71a40b0556da", "tag": "be44aa42-322c-4fb9-9860-b0f9c29a9800"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:05:57.636957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:57.637778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:57.638434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:57.653198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] Creating event network-changed:be44aa42-322c-4fb9-9860-b0f9c29a9800 for instance 7f34ff7a-4a51-4395-9343-71a40b0556da on hv-cinder-81566 Aug 11 10:05:57.659255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-0a93edf1-57c7-4ce4-b078-ccd3309761a5 req-025f9c87-42f5-4b6b-8ac4-40036c0c8aa7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047785 Aug 11 10:05:57.659858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 421/826] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:05:58.584197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:58.584926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:58.592556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:58.593121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:58.593565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:58.594292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:58.595020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:58.595601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:58.803001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:05:58.815381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d460afdb-e3bf-477f-8671-d3d702ff265b tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.235672 Aug 11 10:05:58.823026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 406/827] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:58 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:05:59.839424 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:59.840107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:59.846729 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:59.847353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:59.847887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:59.848750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:59.849319 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:59.849835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:59.854424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:05:59.856778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:05:59.863181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:59.865506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:59.865506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:59.865506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:05:59.865506 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:05:59.865855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:05:59.897872 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e48d9c51-b592-4280-9118-d77b0df6ee4f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046803 Aug 11 10:05:59.897872 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 407/828] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:05:59 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:05:59.996902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:00.018078 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7203f68a-e72f-4716-83f9-7d2086cec1ef tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.183383 Aug 11 10:06:00.018746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 422/829] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:05:59 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:00.020903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:00.023089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:00.029801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.030280 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.030708 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.031585 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.032025 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.032476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.061204 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e2c892a3-5cd8-4032-a7ec-fc771874c8be tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044148 Aug 11 10:06:00.061770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 408/830] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:06:00 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 10:06:00.122845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:00.123333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:00.129261 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.130747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.130747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.131015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.131296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.131720 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.156813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:06:00.362460 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:00.476492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ab25b43b-1dd7-4a6e-a8b8-c5a26ce063d5 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 204 len: 0 microversion: 2.1 time: 0.357220 Aug 11 10:06:00.477122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 423/831] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:06:00 2022] DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:06:00.485670 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:00.486295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:00.492605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.493705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.494473 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.495501 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:00.496112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:00.496538 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:00.628397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:00.637253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-715970e3-1238-436e-ac9e-a1c22915bfa0 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1675 microversion: 2.1 time: 0.155559 Aug 11 10:06:00.637830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 409/832] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:00 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:01.040430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:01.041284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:01.048286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:01.048780 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:01.049228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:01.049940 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:01.050384 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:01.050799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:01.192835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:01.206077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6e4f24ee-953f-4882-9740-f7f3d6fc3378 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.170144 Aug 11 10:06:01.206663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 424/833] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:01 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:01.657758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:01.658369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:01.664707 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:01.665228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:01.666154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:01.666944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:01.667313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:01.667738 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:01.808502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:01.816138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-49a33e18-fc57-4434-ba7d-4293cce414e2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1675 microversion: 2.1 time: 0.162201 Aug 11 10:06:01.816892 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 410/834] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:01 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:02.227286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:02.228020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:02.235569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:02.236114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:02.236541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:02.237278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:02.237721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:02.238133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:02.374356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:02.381875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8c60d715-0ebe-445f-a3bb-9940261777bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.158357 Aug 11 10:06:02.396969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 425/835] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:02 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:02.837601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:02.838539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:02.851246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:02.856320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:02.856320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:02.856320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:02.856320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:02.857227 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:02.996324 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:03.055896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:03.066486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ac1c21d0-c166-4820-a153-5477458cb09c tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1675 microversion: 2.1 time: 0.232803 Aug 11 10:06:03.067258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 411/836] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:02 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:03.404994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:03.406371 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:03.408130 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:03.408946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=6 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:03.417260 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:03.417939 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:03.418441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:03.419147 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:03.419719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:03.420138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:03.780530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a98817-fde9-4929-a63a-62e85d8d94f5", "name": "network-vif-deleted", "tag": "e9d81aa8-69b7-4779-a961-f10861b28c28"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:03.793275 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:03.793905 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:03.794463 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:03.808194 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] Creating event network-vif-deleted:e9d81aa8-69b7-4779-a961-f10861b28c28 for instance 53a98817-fde9-4929-a63a-62e85d8d94f5 on hv-cinder-81566 Aug 11 10:06:03.813607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-a920b62b-fbfb-48f2-be81-ce6a88052349 req-e97d2228-2a3a-49b7-a51c-d4eb0a72ee4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037203 Aug 11 10:06:03.814476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 412/837] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:06:03.858109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:03.865965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a739215-647e-454e-b73f-a01885690f89 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.464618 Aug 11 10:06:03.866867 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 426/838] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:03 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:04.088793 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:04.089683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:04.096338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:04.096818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:04.097278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:04.097967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:04.098415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:04.098835 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:04.166070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:04.173562 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-eee32891-8d6d-44ac-9315-4eba517d7fd1 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1322 microversion: 2.1 time: 0.089538 Aug 11 10:06:04.174124 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 413/839] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:04 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1322 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:04.887121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:04.887679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:04.894147 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:04.894622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:04.895047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:04.895783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:04.896231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:04.896647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:05.034946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:05.042960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-14d4b8f1-277b-4d33-80f8-f5ad566514a9 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.160125 Aug 11 10:06:05.043696 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 427/840] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:04 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:05.194978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:05.195587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:05.202053 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:05.202537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:05.202979 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:05.203737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:05.204196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:05.204774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:05.236817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:05.237331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:05.237762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:05.238202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lazy-loading 'fault' on Instance uuid 53a98817-fde9-4929-a63a-62e85d8d94f5 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:06:05.279803 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2fc568ee74d35bba01c6ce294edeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90177d2267614a389ae39922cba114e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:05.287335 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-25900d51-5ae6-47da-bb2a-dacb90de9b9f tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 200 len: 1327 microversion: 2.1 time: 0.096193 Aug 11 10:06:05.287983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 414/841] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:05 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:06.064373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:06.064968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:06.071300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:06.071774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:06.072198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:06.072870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:06.073475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:06.073988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:06.207126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:06.214738 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2fb5ead0-00bc-4cb4-96b7-46bbca04af2f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.154194 Aug 11 10:06:06.215297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 428/842] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:06 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:06.308737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:06.309384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:06.315689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:06.316105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:06.316531 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:06.317235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:06.317680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:06.318096 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:06.331618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 HTTP/1.1 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:06:06.333246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:06.334861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '53a98817-fde9-4929-a63a-62e85d8d94f5'} Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:06.335776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:06.337282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:06.338633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:06.338633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ecfdb83b-ed08-4f8a-84da-5f4ec3316e91 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 404 len: 111 microversion: 2.1 time: 0.030349 Aug 11 10:06:06.338633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 415/843] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:06 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:06.344469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c0867ff0-dba4-4663-a41a-62eb77117dd3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '.version_select at 0x7f787c147c10>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:06.460881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c0867ff0-dba4-4663-a41a-62eb77117dd3 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164249943" status: 202 len: 0 microversion: 2.1 time: 0.120333 Aug 11 10:06:06.461486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 429/844] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Aug 11 10:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164249943 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:06:07.240977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:07.241617 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:07.247687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:07.248176 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:07.248611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:07.249331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:07.249787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:07.250209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:07.383529 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:07.391756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-75b3f200-8254-4a7b-9881-db7c4525a9bc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.154701 Aug 11 10:06:07.392319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 416/845] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:07 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:08.412889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:08.413513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:08.419536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:08.427522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:08.427522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:08.427522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:08.427522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:08.428269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:08.565582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:08.574416 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e86fcf48-f8d1-4d15-938c-fd6c409b2d2c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.165799 Aug 11 10:06:08.575191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 430/846] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:08 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:09.595967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:09.597115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:09.602870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:09.609039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:09.609039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:09.609039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:09.609039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:09.609619 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:09.745611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:09.755099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c0a6e83b-6434-4fe5-a99f-ca8793f42ecd tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.163238 Aug 11 10:06:09.755852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 417/847] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:09 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:10.347353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f34ff7a-4a51-4395-9343-71a40b0556da", "name": "network-vif-plugged", "status": "completed", "tag": "be44aa42-322c-4fb9-9860-b0f9c29a9800"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:10.357528 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.358060 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.358470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.369569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] Creating event network-vif-plugged:be44aa42-322c-4fb9-9860-b0f9c29a9800 for instance 7f34ff7a-4a51-4395-9343-71a40b0556da on hv-cinder-81566 Aug 11 10:06:10.375157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-0ab5c52a-3024-47cb-b26b-70062948ea18 req-eb8db2ba-e8f7-4b29-8a59-a72a81e978a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Aug 11 10:06:10.375955 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 431/848] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:10.775572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:10.776190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:10.783862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.784410 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.784820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.785542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.786000 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.786421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.790721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:10.824976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:10.825666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:10.832090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.834090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.834090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.834090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.834362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.834601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.849494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 HTTP/1.1 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:06:10.851155 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.852689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '53a98817-fde9-4929-a63a-62e85d8d94f5'} Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:10.857414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.860256 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:10.860256 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-63178699-db05-4a74-b335-0ad5000d89b2 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 404 len: 111 microversion: 2.1 time: 0.032304 Aug 11 10:06:10.860256 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 432/849] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:06:10 2022] DELETE /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:10.864174 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:10.864777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: 53a98817-fde9-4929-a63a-62e85d8d94f5] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:10.871279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.871863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.872297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.872986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:10.873461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:10.873879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:10.889636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 HTTP/1.1 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:06:10.891165 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.892777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '53a98817-fde9-4929-a63a-62e85d8d94f5'} Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:10.893601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. Aug 11 10:06:10.894790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:10.895847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance 53a98817-fde9-4929-a63a-62e85d8d94f5 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:10.895847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-56b4de08-c49e-4ceb-a1fa-d5bf33ff14da tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5" status: 404 len: 111 microversion: 2.1 time: 0.035301 Aug 11 10:06:10.895847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 433/850] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:10 2022] GET /compute/v2.1/servers/53a98817-fde9-4929-a63a-62e85d8d94f5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:10.932577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:10.940398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5594826e-c95d-4806-8dbd-feb5928c82c8 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.169104 Aug 11 10:06:10.940964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 418/851] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:10 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:11.962228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:11.962832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:11.970008 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:11.970572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:11.970995 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:11.971678 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:11.972141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:11.972769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.106583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:12.113956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-893a5b1e-900f-4f57-818a-b61e657a00ec tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1265 microversion: 2.1 time: 0.155649 Aug 11 10:06:12.114511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 434/852] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:11 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:12.175984 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:12.176472 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:12.184098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.184574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.185001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.185777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.186225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.186714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.202798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 HTTP/1.1 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:06:12.204251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.205827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'e982719f-0cc3-44b1-aebb-f7832a9e7440'} Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:12.206622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.208126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.209610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:12.209610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b36c4569-a263-49b3-8aa6-adf2dd641518 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 404 len: 111 microversion: 2.1 time: 0.033560 Aug 11 10:06:12.209610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 419/853] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:06:12 2022] DELETE /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:12.214192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:12.214822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] [instance: e982719f-0cc3-44b1-aebb-f7832a9e7440] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:12.221190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.221662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.222087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.222759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.223205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.223619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.236936 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] HTTP exception thrown: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Request method failure captured: Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 HTTP/1.1 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMOSsTUXuUBD-dhLKAhCfUuWkXYkXDB8MLVmHQsxeVvbBXQJR5pZ7Ex4lEqSRIGwCdLz4RTD15zEjOJCv06K3CdEdgSJtWNMSnBfMMNo79Ez28WfqnisKGjORbNiB2MTvMvx7bkUWF5DAu9pD6oomnqX3vSp_3McNaYW3lj0MJHA7o Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:06:12.238449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90177d2267614a389ae39922cba114e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90177d2267614a389ae39922cba114e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90177d2267614a389ae39922cba114e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 90177d2267614a389ae39922cba114e2 Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865826263 Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: d6c2fc568ee74d35bba01c6ce294edeb Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeTestJSON-1865826263-project Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.239994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'e982719f-0cc3-44b1-aebb-f7832a9e7440'} Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:12.240855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. Aug 11 10:06:12.242295 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:12.243622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] Returning 404 to user: Instance e982719f-0cc3-44b1-aebb-f7832a9e7440 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:12.243622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-385b1f08-59c9-4b5a-b005-d6312b8a7d23 tempest-AttachVolumeTestJSON-1865826263 tempest-AttachVolumeTestJSON-1865826263-project] 10.222.0.17 "GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440" status: 404 len: 111 microversion: 2.1 time: 0.029396 Aug 11 10:06:12.243622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 435/854] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:12 2022] GET /compute/v2.1/servers/e982719f-0cc3-44b1-aebb-f7832a9e7440 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:12.773354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:12.774021 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:12.780129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.780610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.781058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.781744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:12.782221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:12.782635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:12.806018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-26c60c35-0bdd-4296-b1e0-79630f1db088 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/ips" status: 200 len: 152 microversion: 2.20 time: 0.036931 Aug 11 10:06:12.806582 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 420/855] 10.222.0.17 () {60 vars in 1289 bytes} [Thu Aug 11 10:06:12 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:06:13.135201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:13.136576 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:13.144375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:13.145408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:13.145927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:13.147077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:13.148647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:13.149080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:13.328651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:13.337794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-af3d3fb7-dc00-4b97-bbc3-28f0b4e598b3 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1451 microversion: 2.1 time: 0.206839 Aug 11 10:06:13.338389 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 436/856] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:13 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1451 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:13.358665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:13.359565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:13.372917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:13.372917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:13.372917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:13.378245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:13.379039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:13.379551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:13.702092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:13.711920 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7c5bac46-b0a3-44a5-ad34-0c05fe4d8315 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1451 microversion: 2.1 time: 0.356726 Aug 11 10:06:13.713448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 421/857] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:13 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1451 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:15.119346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:15.119954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:15.128109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:15.128893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:15.129499 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:15.130907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:15.131374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:15.131799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:15.205755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'flavor' on Instance uuid 8e61f10f-be72-4757-b23b-0f3e2dc4026f {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:06:15.209642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:15.754597 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b3f4530e-f009-4377-b78b-d2a90b0c70ef tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/action" status: 202 len: 0 microversion: 2.20 time: 0.639222 Aug 11 10:06:15.755395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 437/858] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Aug 11 10:06:15 2022] POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:06:15.768153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:15.769798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:15.782200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:15.782692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:15.787900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:15.789520 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:15.790522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:15.791112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:16.033085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:16.044987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:16.046889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:16.050671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-606297f3-2303-4c97-b3fa-a5efdbbed58b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.290027 Aug 11 10:06:16.051934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 422/859] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:15 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:16.102407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f34ff7a-4a51-4395-9343-71a40b0556da", "tag": "be44aa42-322c-4fb9-9860-b0f9c29a9800"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:16.112336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:16.112840 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:16.113329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:16.126029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] Creating event network-changed:be44aa42-322c-4fb9-9860-b0f9c29a9800 for instance 7f34ff7a-4a51-4395-9343-71a40b0556da on hv-cinder-81566 Aug 11 10:06:16.130851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-603b7ff7-a746-4e3a-9de7-2b7b3991d457 req-03065ca9-02f2-4a22-9db9-b6486e093b65 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035773 Aug 11 10:06:16.131765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 438/860] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:17.075338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:17.075991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:17.089336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:17.090591 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:17.091401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:17.092691 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:17.106777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:17.117510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:17.402898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:17.418740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:17.420497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:17.421957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1c786b3a-80e0-4a41-9714-742cba704237 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.351623 Aug 11 10:06:17.423018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 423/861] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:17 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:18.445634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:18.451847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:18.458591 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:18.459642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:18.459642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:18.460349 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:18.460805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:18.461267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:18.609226 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:18.617348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:18.618844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:18.619994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e350fdcb-710d-4472-b75f-47e9ee75c36c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.179397 Aug 11 10:06:18.623392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 439/862] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:18 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:19.647245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:19.647245 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:19.651897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:19.652446 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:19.653366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:19.654068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:19.654522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:19.655260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:19.842923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:19.851158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:19.852870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:19.854148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9754ff37-2e44-4bc4-98f9-60339a014004 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.213882 Aug 11 10:06:19.854867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 424/863] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:19 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:20.877423 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:20.878029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:20.886901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:20.891408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:20.891408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:20.891408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:20.891408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:20.891773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:21.046719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:21.055017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:21.056859 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:21.058542 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fd4ab585-3724-496f-9d93-2878d0de7f98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.184927 Aug 11 10:06:21.074658 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 440/864] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:20 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:22.083400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:22.084005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:22.091700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:22.098360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:22.098360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:22.098360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:22.098360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:22.098710 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:22.236059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:22.244072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:22.246913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:22.248122 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bd50e74c-d586-4c04-853c-f067a043ef92 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.168876 Aug 11 10:06:22.249000 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 425/865] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:22 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:23.271065 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:23.271703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:23.279267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:23.281069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:23.281069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:23.281069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:23.281476 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:23.281900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:23.533296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:23.541328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:23.543086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:23.544269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6d36b73b-f208-49cc-9575-5ab7815884ad tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.277262 Aug 11 10:06:23.545413 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 441/866] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:23 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:24.571400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:24.572618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:24.588722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:24.589544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:24.591564 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:24.593131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:24.594238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:24.594887 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:25.138841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:25.151641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:25.153173 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:25.156565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ab4878be-4fa8-42e2-bff5-ca273146c05e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.588580 Aug 11 10:06:25.157180 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 426/867] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:24 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:26.179768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:26.183344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:26.188382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:26.188876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:26.189377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:26.190110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:26.190565 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:26.190987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:26.333962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:26.346064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:26.347546 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:26.348710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c381528a-6792-419e-aaae-369653dbf294 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.173140 Aug 11 10:06:26.352616 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 442/868] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:26 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:27.381735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:27.382415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:27.384982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=48 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:27.393465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:27.393465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:27.393465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:27.393465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:27.393860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:27.393860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:27.557671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:27.569170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:27.571965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:27.573277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-02d49032-9770-4452-8cc8-4aff14d9fb98 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.195516 Aug 11 10:06:27.573909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 427/869] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:27 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:28.597117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:28.597999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:28.604895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:28.605627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:28.606086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:28.606799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:28.607392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:28.607977 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:28.779448 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:28.788688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:28.790531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:28.792664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ea506713-7626-47e8-a592-8d8ef1d7c8fb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.199893 Aug 11 10:06:28.801831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 443/870] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:28 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:29.817828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:29.819170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:29.830966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:29.877856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:29.877856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:29.877856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:29.877856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:29.881322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:30.101402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:30.113064 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:30.114581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:30.116008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f0e57336-e437-4b3f-ab49-24c7482f35a9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.303751 Aug 11 10:06:30.125431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 428/871] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:29 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:30.808375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:30.808962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:30.815378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:30.816208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:30.816641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:30.817391 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:30.818754 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:30.819411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:30.856856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3d8c0f25-044c-419b-9795-d483fc017e65 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/ips" status: 200 len: 150 microversion: 2.1 time: 0.052453 Aug 11 10:06:30.858196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 444/872] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:06:30 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:31.140630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:31.141301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:31.148132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:31.148628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:31.149085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:31.150008 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:31.150469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:31.150902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:31.404947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:31.419390 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:31.424151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:31.425486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b493fd78-6a29-44de-9f28-39ecd500f873 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.289612 Aug 11 10:06:31.426591 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 429/873] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:31 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:32.453579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:32.454704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:32.457388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:32.462374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:32.463082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:32.463783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:32.464739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:32.465218 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:32.465695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:32.622792 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:32.631500 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:32.633303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:32.634636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1fc0ab93-f2ea-4c06-becd-1d5055e69146 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.186884 Aug 11 10:06:32.635194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 445/874] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:32 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:33.660763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:33.661405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:33.675586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:33.676516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:33.677652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:33.678572 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:33.679697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:33.681483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:33.867169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:33.885874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:33.887767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:33.889807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9f57a7f7-7020-4bde-9392-0607e979e592 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.233784 Aug 11 10:06:33.905107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 430/875] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:33 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:34.662356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2f3b8e7-25c1-4a43-9429-bcc2f90a54e5"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:34.666135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:34.673915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:34.674701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:34.675297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:34.676160 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:34.676764 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:34.677356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:34.917938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:34.919650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:34.930065 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:34.930936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:34.931799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:34.933553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:34.935032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:34.935696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:35.153241 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:35.182795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:35.184465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:35.185897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c08477b2-9f4e-45f9-bc3a-0158656d8885 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1745 microversion: 2.20 time: 0.275740 Aug 11 10:06:35.186961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 431/876] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:34 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1745 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:06:35.600987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-89c379d3-dfa4-4fcd-bb74-fa3ac18ceb1f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "POST /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942360 Aug 11 10:06:35.601709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 446/877] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:06:34 2022] POST /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:36.211272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:36.211935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:36.220437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:36.220919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:36.221418 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:36.222121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:36.222593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:36.229565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:36.444639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:36.461174 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:36.462773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:36.464626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-231c393e-c997-4d04-a5e5-9390506ec132 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1745 microversion: 2.20 time: 0.257299 Aug 11 10:06:36.475490 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 432/878] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:36 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1745 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:37.502865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:37.503555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:37.518417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:37.520494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:37.520494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:37.522262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:37.524041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:37.524793 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:37.703454 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:37.717278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:37.719314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:37.720728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6ea69273-2ce3-45da-88f0-855aac0fff78 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.222822 Aug 11 10:06:37.733040 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 447/879] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:37 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:38.747295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:38.748251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:38.763342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:38.764124 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:38.772452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:38.773689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:38.774366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:38.774945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:39.014213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:39.023498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:39.025366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:39.027524 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5db95ff7-3762-4d73-b59e-bc5de99886ff tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.284764 Aug 11 10:06:39.041598 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 433/880] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:38 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:39.769934 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "name": "network-vif-plugged", "status": "completed", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:39.789104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:39.789752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:39.790206 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:39.823248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] Creating event network-vif-plugged:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:06:39.834698 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-516d2c31-6472-437c-9a13-c770e160e6df req-1d238d08-6da2-45ed-a342-3a56b25929a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068285 Aug 11 10:06:39.838227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 448/881] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:40.054574 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:40.055202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:40.086314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:40.088231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:40.088231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:40.101318 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:40.102367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:40.103305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:40.388021 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:40.400323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:40.405711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:40.412351 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-775b97a1-88c3-4d69-b663-e8dcc97778d6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.363423 Aug 11 10:06:40.413253 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 434/882] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:40 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:41.439668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:41.440296 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:41.446930 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:41.447498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:41.448759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:41.449509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:41.449963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:41.450564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:41.591132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:41.600621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:41.602411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:41.603734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-99203f76-a43a-4bdd-9c4c-69f50adf013e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.169426 Aug 11 10:06:41.604767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 449/883] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:41 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:42.638691 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:42.639700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:42.647168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:42.648017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:42.649028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:42.650206 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:42.651549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:42.652447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:42.655849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=95 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:42.849782 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:42.859225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:42.865573 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:42.867133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-186cee9c-ee70-43d4-9b8d-9fa2fc25401c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.239944 Aug 11 10:06:42.881476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 435/884] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:42 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:43.894736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:43.896123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:43.911834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:43.913172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:43.913493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:43.914219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:43.915107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:43.915566 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:44.143502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:44.154917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:44.156691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:44.158229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a2b78a35-a4fb-45af-b99f-31213afaf9cb tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.268873 Aug 11 10:06:44.159403 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 450/885] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:43 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:44.705763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:44.706891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:44.715290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:44.716062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:44.716650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:44.717565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:44.718447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:44.719110 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:44.830082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'services' on Instance uuid 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:06:45.192200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2c3592fb-89c0-4dd8-aee5-68b46365e80c tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments/c2f3b8e7-25c1-4a43-9429-bcc2f90a54e5" status: 202 len: 0 microversion: 2.1 time: 0.492326 Aug 11 10:06:45.193176 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 436/886] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:06:44 2022] DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments/c2f3b8e7-25c1-4a43-9429-bcc2f90a54e5 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:06:45.221278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:45.222746 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:45.231730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:45.232615 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:45.233081 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:45.233975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:45.234440 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:45.234865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:45.251123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:45.255609 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:45.271394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:45.271914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:45.272372 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:45.273138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:45.273622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:45.274516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:45.319144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc5b8fab-e535-47f1-a1f9-4111cb7a6c9f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084643 Aug 11 10:06:45.320310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 437/887] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:06:45 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:45.384194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:45.394135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:45.395630 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:45.396787 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-978e4528-e527-4014-b7e7-c3925eea7a52 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.218569 Aug 11 10:06:45.397376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 451/888] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:45 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:46.333082 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:46.337883 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:46.358080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:46.361718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:46.362553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:46.368326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:46.368326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:46.368326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:46.420599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:46.421893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:46.433490 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:46.435733 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:46.436342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:46.438320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:46.438788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:46.443535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:46.452505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:46.460199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-62fcaa2d-b8f4-4008-860f-094e415448df tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128622 Aug 11 10:06:46.461198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 438/889] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:06:46 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:06:46.705584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:46.730267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:46.732773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:46.734365 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cec4b08b-7dc3-43bc-8c0b-f6124ec6dfd9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.318652 Aug 11 10:06:46.735264 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 452/890] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:46 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:47.259602 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6b177537-54af-47b0-bb2f-805397e32aba tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'create', calling method: .version_select at 0x7f787c0db3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2137065692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTHz2TNcms6mYEENqOamEqFKG4Y59UpEy0kER/g469HfFUHgN2JFdVjf46KYpNpTxrrNWX58UrXyOPGNywer3iPT0rphVnLTfSVncFJ2RFr/jljxek1Mz/uIThKKAbu+Q=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:47.275850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-6b177537-54af-47b0-bb2f-805397e32aba tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Getting quotas for project 93eee20443c14b739e06abe3eba34c44. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:06:47.280225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-6b177537-54af-47b0-bb2f-805397e32aba tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Getting quotas for user 1f3839edcb09423b8b4885dffbd87af9 and project 93eee20443c14b739e06abe3eba34c44. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:06:47.358489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6b177537-54af-47b0-bb2f-805397e32aba tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.102666 Aug 11 10:06:47.359869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 439/891] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:06:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:47.473524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:47.475774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:47.485887 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1176512876", "imageRef": "2ab05a41-17e5-45d2-982b-7dbedb74ce59", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2137065692", "networks": [{"uuid": "ea5ae415-63af-4194-b780-12a0f1424b29"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:47.486623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:47.487106 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:47.487533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:47.488215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:47.488657 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:47.489097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:47.529818 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8dc6a0f6-f0df-49ff-b200-9b2e5001b48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060385 Aug 11 10:06:47.533550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 453/892] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:06:47 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:06:47.566721 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] validate_networks() for [('ea5ae415-63af-4194-b780-12a0f1424b29', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:06:47.602486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:47.603293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:47.609922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:47.610397 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:47.610996 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:47.612834 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:47.613313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:47.613727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:47.645486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:06:48.055132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:06:48.055714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:06:48.056828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:06:48.057888 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:06:48.058445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:06:48.068706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2d340a12-633c-453e-9e6a-2820db0bcba3 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 204 len: 0 microversion: 2.1 time: 0.469554 Aug 11 10:06:48.073539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 454/893] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:06:47 2022] DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:06:48.079486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:48.083976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:48.086257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.086754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.087662 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.088839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.089340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.089751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.091591 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.092302 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.093123 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.096501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.096501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.096501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.120168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Getting quotas for project 93eee20443c14b739e06abe3eba34c44. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:06:48.129360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Getting quotas for user 1f3839edcb09423b8b4885dffbd87af9 and project 93eee20443c14b739e06abe3eba34c44. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:06:48.141960 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:06:48.144222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ab05a41-17e5-45d2-982b-7dbedb74ce59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:06:48.256291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-de593783-97a3-450b-963e-72b9ca752522 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774111 Aug 11 10:06:48.257756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 440/894] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 10:06:48.264502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:48.274650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:48.275268 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:48.278004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:48.279533 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:48.280719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-aa633acd-0df1-4f9d-acfc-8bedd674a3e7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.206320 Aug 11 10:06:48.281380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 455/895] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:48 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:48.293482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b619e72c-1d95-4b6b-a1a0-cf09a1c636a5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:48.293482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b619e72c-1d95-4b6b-a1a0-cf09a1c636a5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:48.294651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.294752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.295416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.295815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:48.296305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:48.300232 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:48.397946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b619e72c-1d95-4b6b-a1a0-cf09a1c636a5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:48.404742 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b619e72c-1d95-4b6b-a1a0-cf09a1c636a5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1259 microversion: 2.1 time: 0.122342 Aug 11 10:06:48.409119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 456/896] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:48 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:48.522542 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:48.530600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8a3de49a-ff82-4139-9d34-439a8b6d1844 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1682 microversion: 2.1 time: 0.271694 Aug 11 10:06:48.531166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 441/897] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:48 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:49.311604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:49.312330 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:49.328013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:49.330782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:49.330782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:49.330782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:49.330782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:49.332774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:49.569902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-dd3c2878-d5d8-4a9b-9810-7daca080427f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:49.569902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-dd3c2878-d5d8-4a9b-9810-7daca080427f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:49.570452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:49.570452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:49.570700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:49.570700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-77009d54-dbe4-4c93-9690-81bf9ffb8326 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.181836 Aug 11 10:06:49.570700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 457/898] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:49 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:06:49.571018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-dd3c2878-d5d8-4a9b-9810-7daca080427f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:49.571018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-dd3c2878-d5d8-4a9b-9810-7daca080427f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1259 microversion: 2.1 time: 0.079091 Aug 11 10:06:49.571018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 442/899] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:49 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:06:49.571313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:49.571313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:49.571313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:49.571313 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:49.572961 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:49.572961 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:49.572961 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:49.572961 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:49.725103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:49.733074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bb786ba2-769e-40d9-a9c4-64565c677197 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1682 microversion: 2.1 time: 0.183845 Aug 11 10:06:49.736489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 458/900] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:49 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:50.515636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:50.516240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:50.523746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.524231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.524666 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.524811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:50.525386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.525656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:50.525878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.526551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.534881 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.535510 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.536029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.536814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.537399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.537912 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.621639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:50.629388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-db9164df-edb1-4fee-b6d2-c2002e5616be tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1255 microversion: 2.1 time: 0.109069 Aug 11 10:06:50.630045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 459/901] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:50 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1255 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:50.686346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:50.694425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:50.695918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:50.697135 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ffa22000-5673-4563-9a80-85f36688b7de tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.185936 Aug 11 10:06:50.697692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 443/902] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:50 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:50.755724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:50.756474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:50.763904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.764469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.764972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.765822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:50.766270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:50.766686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:50.849811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:50.860583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4354ad1e-2ca3-4de7-8d22-4869c7c883da tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1615 microversion: 2.1 time: 0.108638 Aug 11 10:06:50.861470 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 460/903] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:50 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1615 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:51.112128 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7d34b9-1317-48cc-9d8c-f1147f5fd488", "name": "network-vif-deleted", "tag": "4920c93f-63bb-4886-bee4-b0117a541d6e"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:51.122642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.123230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.123746 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.136261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] Creating event network-vif-deleted:4920c93f-63bb-4886-bee4-b0117a541d6e for instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 on hv-cinder-81566 Aug 11 10:06:51.141381 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-62e4998b-60cd-47c2-8f59-2068a256217b req-73e2c537-fe30-4bd3-b1f3-4b7023ee1be6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Aug 11 10:06:51.142058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 444/904] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:51.650879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:51.651638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:51.658131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.658613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.659041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.659721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.660190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.660610 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.725391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:51.725391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:51.725950 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:51.730529 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.731402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.732080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.732329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b35c37b9-3d36-4856-9921-a76793a241f5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1255 microversion: 2.1 time: 0.085220 Aug 11 10:06:51.732944 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 461/905] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:51 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:51.733583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.734108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.734633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.880636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:51.882431 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:51.883035 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:51.890151 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.891719 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:51.892906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.893304 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:51.894543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f6cc6ef2-3139-404f-9c35-e7345fffa3d3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.177645 Aug 11 10:06:51.895120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 445/906] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:51 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:06:51.896957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.902853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:51.902853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:51.902853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:51.965976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:51.973937 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-379381c7-6c0f-4c14-a77a-8ccaba2069e9 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1615 microversion: 2.1 time: 0.095349 Aug 11 10:06:51.974508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 462/907] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:51 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:06:52.753402 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:52.754017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:52.760319 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:52.760777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:52.761290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:52.761975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:52.762424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:52.762845 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:52.832770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:52.841299 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0e0db0d6-24ac-4138-87e2-65f3a8105c17 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1255 microversion: 2.1 time: 0.091901 Aug 11 10:06:52.841873 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 446/908] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:52 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1255 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:52.922816 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:52.923414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:52.929869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:52.930344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:52.930767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:52.931530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:52.932016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:52.932434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:52.996281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:52.997425 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:53.003449 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:53.003934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:53.004369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:53.005092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:53.005545 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:53.006132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:53.078285 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:53.085700 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e5a269c2-ed55-4617-b555-a832064f43af tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1327 microversion: 2.1 time: 0.093702 Aug 11 10:06:53.095495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:53.099020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 447/909] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:52 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:53.103582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:53.106175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:53.107339 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ee3512a4-0c98-4a8f-9f80-7ef05dc3b7fa tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1740 microversion: 2.20 time: 0.194004 Aug 11 10:06:53.107894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 463/910] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:52 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:53.870952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:53.871558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:53.877950 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:53.878426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:53.878854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:53.879533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:53.879979 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:53.880395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:53.941996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:53.950005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-699da76c-0f41-4fe2-95a7-c4bf82928b95 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1311 microversion: 2.1 time: 0.086926 Aug 11 10:06:53.953250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 448/911] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:53 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:54.114611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:54.115379 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:54.121948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.122550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.123103 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.124064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.124617 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.130049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:54.130771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:54.134396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.138254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.138974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.142547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.142547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.142547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.142547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.171856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.172574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.175009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.176359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lazy-loading 'fault' on Instance uuid 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:06:54.290629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b31650305943b498f02c882baa0144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22d997be9cb4bbb8235eda18fa92074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:54.298058 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-15acd1c0-32c8-4f95-8796-4673414dbd9e tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 200 len: 1332 microversion: 2.1 time: 0.187677 Aug 11 10:06:54.312534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 464/912] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:54 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:54.489423 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:54.498038 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:54.506577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:54.506577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c633e788-3de3-467a-af41-451c949147c7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1722 microversion: 2.20 time: 0.376013 Aug 11 10:06:54.506577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 449/913] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:54 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:06:54.970845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:54.971446 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:54.977570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.978068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.978481 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:54.981177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:54.981177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:54.981177 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:55.055986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:55.063569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-500f5f78-1e8f-49fc-9cae-9a7bc4c235ef tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1317 microversion: 2.1 time: 0.096975 Aug 11 10:06:55.064135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 465/914] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:54 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:55.320396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:55.320918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:55.327840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:55.328477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:55.328912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:55.329819 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:55.330266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:55.330684 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:55.346496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 HTTP/1.1 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:06:55.348142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:55.349909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '3b7d34b9-1317-48cc-9d8c-f1147f5fd488'} Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:55.350912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:55.352416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:55.353971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:55.353971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0434ed72-b31e-4e1a-be95-ca4f36d02c90 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 404 len: 111 microversion: 2.1 time: 0.033332 Aug 11 10:06:55.353971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 450/915] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:55 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:55.362513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-11e70742-0da6-4093-88b6-22da2c30c48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '.version_select at 0x7f787c0e8790>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:55.450134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-11e70742-0da6-4093-88b6-22da2c30c48f tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026562322" status: 202 len: 0 microversion: 2.1 time: 0.095127 Aug 11 10:06:55.450781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 466/916] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Aug 11 10:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026562322 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 10:06:55.524724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:55.525471 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:55.532150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:55.537589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:55.537589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:55.537589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:55.537589 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:55.537992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:55.669807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:55.689676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:55.691400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:55.694105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-60119a60-de2e-4e54-ad41-d9244fce5b7f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1722 microversion: 2.20 time: 0.171853 Aug 11 10:06:55.694105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 451/917] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:55 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:56.084652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:56.085280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:56.091475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:56.092000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:56.092436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:56.093409 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:56.093863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:56.094284 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:56.469270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:56.477005 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d1679a40-3906-4af2-901e-69772abaca0b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.396273 Aug 11 10:06:56.477590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 467/918] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:56 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:56.715948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:56.716457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:56.723172 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:56.723655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:56.724089 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:56.724775 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:56.725255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:56.725770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:56.854945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:56.863498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:56.864970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:56.866137 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d4c4038f-0afa-4971-8bc7-78204e142605 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1722 microversion: 2.20 time: 0.154343 Aug 11 10:06:56.866689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 452/919] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:56 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:57.498574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:57.499184 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:57.505643 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:57.506121 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:57.506552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:57.507233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:57.507683 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:57.508104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:57.638965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:57.642878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:57.647749 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a29c4dfd-3555-4e83-9379-fe348287ffd9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.153852 Aug 11 10:06:57.648314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 468/920] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:57 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:57.744763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "name": "network-vif-unplugged", "status": "completed", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:57.758593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:57.759223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:57.759786 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:57.775328 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] Creating event network-vif-unplugged:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:06:57.781254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-f833f61a-00b8-4dd9-9358-146f7166f577 req-4c732fb3-b06f-488f-abe3-4b09cb126cf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040876 Aug 11 10:06:57.785693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 453/921] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:57.894866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:57.896522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:57.911326 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:57.911906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:57.912412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:57.913255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:57.913987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:57.914791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.145148 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:58.163555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:58.166032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:58.167606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-961aa5b6-7072-438a-8114-a596a234f63c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1722 microversion: 2.20 time: 0.281648 Aug 11 10:06:58.169595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 469/922] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:57 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:58.531343 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:58.535602 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:58.536338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:58.543495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.544279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.544950 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.545703 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.546311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.546998 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.561388 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 HTTP/1.1 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:06:58.563097 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.565912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '3b7d34b9-1317-48cc-9d8c-f1147f5fd488'} Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:58.566874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.568293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.569802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:58.570221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-79493e7f-542b-4e92-aa46-78e6078372f4 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 404 len: 111 microversion: 2.1 time: 0.034296 Aug 11 10:06:58.571343 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 454/923] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:06:58 2022] DELETE /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:58.580760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:58.581410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 3b7d34b9-1317-48cc-9d8c-f1147f5fd488] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:58.585111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:58.590583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.593248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.593248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.593248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.593248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.593673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.610162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 HTTP/1.1 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:06:58.612530 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.614624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '3b7d34b9-1317-48cc-9d8c-f1147f5fd488'} Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:06:58.616322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. Aug 11 10:06:58.618328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:06:58.619730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 3b7d34b9-1317-48cc-9d8c-f1147f5fd488 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:06:58.619730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-07039aac-8e44-4f1b-80c8-e560ac7db1fc tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488" status: 404 len: 111 microversion: 2.1 time: 0.038143 Aug 11 10:06:58.629691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 470/924] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:58 2022] GET /compute/v2.1/servers/3b7d34b9-1317-48cc-9d8c-f1147f5fd488 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:06:58.662530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:58.662530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.662530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.662530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.667873 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:58.669082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:58.675871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.676639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.677310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.683712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] Creating event network-changed:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:06:58.688909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:58.691191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:58.691191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:58.691422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-133cbe73-d673-464f-bb39-4b97e2322fa6 req-db8ed93d-952d-429b-b42d-19af960de6e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050730 Aug 11 10:06:58.691422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 455/925] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:06:58.875558 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:58.886544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c69bad73-641b-46f3-bd8a-04694ac3d55d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.220311 Aug 11 10:06:58.886544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 471/926] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:58 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:06:59.201899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:59.205605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:59.213723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.215273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.215714 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.216879 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.217709 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.218811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.364327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:59.376983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:59.378554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:06:59.379947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e46c0d24-7368-4863-ba4e-4577d1c9d207 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1725 microversion: 2.20 time: 0.184661 Aug 11 10:06:59.397808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 456/927] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:06:59 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:06:59.404507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01a9089a-d5d6-4452-bb61-4fd8f549e9cf"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:06:59.407607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:59.414273 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.416114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.416114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.416114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.416536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.416963 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.906491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:06:59.907155 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:06:59.922771 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=12 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:59.924015 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:59.925408 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.925897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.926334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.927036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:06:59.927487 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:06:59.927906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:06:59.931264 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:00.100760 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:00.112918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-752628cc-1a34-4e62-b44c-0900367eaaf3 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.207614 Aug 11 10:07:00.112918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 457/928] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:06:59 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:07:00.114941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:00.115426 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:00.125267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.125267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.125267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.125267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.125737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.125737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.157061 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 HTTP/1.1 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:00.163104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.164535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '2fce8ed1-33bd-4a45-8348-edc91b8fb137'} Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:00.165567 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.167858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.170656 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:00.171738 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-079dfc7a-b239-4a95-b512-2d48cf8df150 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 404 len: 111 microversion: 2.1 time: 0.060603 Aug 11 10:07:00.176300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 458/929] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:07:00 2022] DELETE /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:00.190577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:00.191139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 2fce8ed1-33bd-4a45-8348-edc91b8fb137] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:00.200452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.205191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.205191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.205191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.205191 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.206092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.253152 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 HTTP/1.1 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:00.256518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.258092 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '2fce8ed1-33bd-4a45-8348-edc91b8fb137'} Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:00.258815 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. Aug 11 10:07:00.259975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.262740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 2fce8ed1-33bd-4a45-8348-edc91b8fb137 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:00.262740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-bce782ce-47ca-49a1-9b3d-634b7e5213c0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137" status: 404 len: 111 microversion: 2.1 time: 0.070500 Aug 11 10:07:00.262740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 459/930] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:00 2022] GET /compute/v2.1/servers/2fce8ed1-33bd-4a45-8348-edc91b8fb137 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:00.267802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:00.268523 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:00.274911 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.275395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.275833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.276521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.277098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.281481 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.298862 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 HTTP/1.1 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:00.300559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.302029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '40073569-0bde-4157-8824-48a436788df4'} Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:00.302777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.303952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.306437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:00.306437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc085702-6b21-416b-b804-80c4c4346c71 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 404 len: 111 microversion: 2.1 time: 0.039340 Aug 11 10:07:00.306437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 460/931] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:07:00 2022] DELETE /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:07:00.312674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:00.313474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: 40073569-0bde-4157-8824-48a436788df4] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:00.321266 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.321855 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.322354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.323300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.323779 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.324409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.343158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 HTTP/1.1 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:00.345197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.346610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '40073569-0bde-4157-8824-48a436788df4'} Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:00.347326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. Aug 11 10:07:00.348514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:00.350748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance 40073569-0bde-4157-8824-48a436788df4 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:00.351768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6d032e39-4bf3-4ae9-8f78-8966213019f0 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4" status: 404 len: 111 microversion: 2.1 time: 0.044225 Aug 11 10:07:00.356049 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 461/932] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:00 2022] GET /compute/v2.1/servers/40073569-0bde-4157-8824-48a436788df4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:00.436115 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d98c6068-a87f-4e71-8818-8920218b3d3a tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.036462 Aug 11 10:07:00.437175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 472/933] 10.222.0.17 () {62 vars in 1364 bytes} [Thu Aug 11 10:06:59 2022] POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments => generated 188 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:07:00.645086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:00.646046 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:00.664445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.664952 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.665420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:00.666131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:00.666779 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:00.667413 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.131794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:01.132492 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:01.142314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.143219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.143646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.144345 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.144796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.145314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.308636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:01.319442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8c65282a-8829-4353-9d30-ef355c320049 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.191339 Aug 11 10:07:01.320018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 473/934] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:01 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:01.373513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-98ce2235-a2e5-4351-b071-7c516bb3937f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments/01a9089a-d5d6-4452-bb61-4fd8f549e9cf" status: 202 len: 0 microversion: 2.20 time: 0.732583 Aug 11 10:07:01.374143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 462/935] 10.222.0.17 () {60 vars in 1457 bytes} [Thu Aug 11 10:07:00 2022] DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments/01a9089a-d5d6-4452-bb61-4fd8f549e9cf => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:07:01.439241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:01.439858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:01.445988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.446482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.446917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.447644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.448098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.448523 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.478848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121197) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 10:07:01.734496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:01.735004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:01.741132 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.741626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.742072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.742840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.743301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.743729 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.759818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 HTTP/1.1 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:01.761665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.763078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'ddfb9f02-1255-481b-b2df-bd1b4b8f9159'} Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:01.763861 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.765100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.766389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:01.766389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5f64d6a9-a46b-4df5-ac5f-758a02a13de5 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 404 len: 111 microversion: 2.1 time: 0.034259 Aug 11 10:07:01.766389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 463/936] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:07:01 2022] DELETE /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 10:07:01.774776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:01.775755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] [instance: ddfb9f02-1255-481b-b2df-bd1b4b8f9159] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:01.783009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5215599d-7b4b-4a40-ad38-a1f85e5c6940 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/action" status: 202 len: 0 microversion: 2.20 time: 0.348048 Aug 11 10:07:01.784877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 474/937] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Aug 11 10:07:01 2022] POST /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:07:01.790838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.795133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.797229 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.798164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.799447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.800427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:01.801994 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.802627 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:01.817719 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.818501 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.819138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.820022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:01.820641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:01.821252 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:01.829605 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] HTTP exception thrown: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Request method failure captured: Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 HTTP/1.1 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NMPJv34pYzg5ywHkuxYYieWi8zXwYmjwx6cFgXX1cL3-MMbvRXRzB7fwfv4LHicG_J78Jcuf9KxhQ9wvfJB0jOVT6CTHK2vgx9Uc1jNfS_6Yi_EFgShYQ3IGG06LTt8JHDEkUlTgLJ8TxpHbl2I7bex2sXwnzgOqwfK35poLwR-Shc Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:07:01.833763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22d997be9cb4bbb8235eda18fa92074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: c22d997be9cb4bbb8235eda18fa92074 Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1811531060 Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 28b31650305943b498f02c882baa0144 Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeNegativeTest-1811531060-project Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.835801 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'ddfb9f02-1255-481b-b2df-bd1b4b8f9159'} Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:07:01.836583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. Aug 11 10:07:01.838503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:07:01.840692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] Returning 404 to user: Instance ddfb9f02-1255-481b-b2df-bd1b4b8f9159 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:07:01.840692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b804ec09-d5e8-4bdc-93fc-ed230f17de36 tempest-AttachVolumeNegativeTest-1811531060 tempest-AttachVolumeNegativeTest-1811531060-project] 10.222.0.17 "GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159" status: 404 len: 111 microversion: 2.1 time: 0.063077 Aug 11 10:07:01.840692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 464/938] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:01 2022] GET /compute/v2.1/servers/ddfb9f02-1255-481b-b2df-bd1b4b8f9159 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:02.040768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:02.049367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:02.050875 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:02.052045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4d3810d8-308c-4b53-a0a2-bec97dfa920f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1733 microversion: 2.20 time: 0.264000 Aug 11 10:07:02.052609 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 475/939] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:01 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:02.342607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:02.344447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:02.352934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:02.353641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:02.354383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:02.355291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:02.355902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:02.356622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:02.549188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:02.557900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-30f6d47b-b9f8-4a65-9fd4-d22e4ca24fb0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.220584 Aug 11 10:07:02.559658 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 465/940] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:02 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:03.081628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:03.082399 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:03.085067 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:03.097593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:03.098494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:03.099167 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:03.100125 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:03.100811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:03.101503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:03.278766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:03.288291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:03.289894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:03.291348 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d24fef67-7751-4bb7-bc93-8203c091e582 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1733 microversion: 2.20 time: 0.213667 Aug 11 10:07:03.291914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 476/941] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:03 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:03.579962 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:03.580747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:03.587320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:03.587817 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:03.588238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:03.588933 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:03.589900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:03.590529 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:03.760495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:03.770054 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-190b921d-5c50-4fba-865a-c83efee31e68 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.193935 Aug 11 10:07:03.774991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 466/942] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:03 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:04.314905 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:04.315551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:04.322836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:04.323556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:04.324175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:04.324940 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:04.325632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:04.326259 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:04.549682 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:04.560005 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:04.561871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:04.563408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b9bc77e3-39ee-46c9-aa0b-7991e3a43cd2 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1733 microversion: 2.20 time: 0.252491 Aug 11 10:07:04.577395 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 477/943] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:04 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:04.796747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:04.797383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:04.804537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:04.805059 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:04.805607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:04.806310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:04.806761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:04.807182 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:05.018850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:05.029919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-48e25f4f-26a9-4168-b776-d5b9fe477331 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.237124 Aug 11 10:07:05.032384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 467/944] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:04 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:05.587823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:05.595418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:05.595418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:05.595916 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:05.596767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:05.597175 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:05.597632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:05.598084 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:05.795734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:05.805336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:05.812561 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:05.813800 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e998f152-7bc5-4181-8a55-61377bbddd27 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1733 microversion: 2.20 time: 0.229888 Aug 11 10:07:05.814369 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 478/945] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:05 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:06.057192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:06.057192 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:06.061367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:06.062188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:06.063221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:06.065267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:06.066020 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:06.066662 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:06.294690 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:06.302586 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-72658435-77a8-4da2-8d15-846bc99a15a4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.252901 Aug 11 10:07:06.303214 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 468/946] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:06 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:06.838139 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:06.838735 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:06.845532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:06.845745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:06.846356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:06.847229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:06.847847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:06.848275 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:07.128710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:07.141944 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:07.143636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:07.144911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2941d435-8cc2-4b89-b21a-2d9207e6bd2c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1733 microversion: 2.20 time: 0.310653 Aug 11 10:07:07.145745 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 479/947] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:06 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1733 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:07.326364 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:07.327622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:07.334184 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:07.334675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:07.335133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:07.335838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:07.336296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:07.336724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:07.566492 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:07.574518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-678875ad-cb4a-4cf3-b1e7-79b295b24d3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.253064 Aug 11 10:07:07.576514 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 469/948] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:07 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:08.168382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:08.168972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:08.176017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:08.176487 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:08.176914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:08.181823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:08.181823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:08.181823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:08.469938 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:08.478003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:08.479491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:08.480640 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a8559669-4087-4bed-8882-d9991fb49d21 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1675 microversion: 2.20 time: 0.316073 Aug 11 10:07:08.481215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 480/949] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:08 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:08.595849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:08.596393 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:08.602856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:08.603338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:08.603768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:08.604454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:08.604900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:08.605498 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:08.737554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:08.744991 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9b7e6482-5c64-4efd-aa9f-bc52787784f0 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.154257 Aug 11 10:07:08.745599 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 470/950] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:08 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:09.506382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:09.506970 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:09.514247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:09.514726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:09.515148 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:09.516642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:09.517318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:09.517710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:09.750048 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:09.758172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:09.759670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:09.760838 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0e1699f1-4f98-4f20-957a-928c9eeb5783 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1675 microversion: 2.20 time: 0.258348 Aug 11 10:07:09.761405 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 481/951] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:09 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:09.766005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:09.766612 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:09.773830 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:09.774516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:09.774940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:09.775790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:09.776407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:09.776827 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:10.060325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:10.067790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8617697e-87d5-4f20-a60d-cb4a806dad41 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.306060 Aug 11 10:07:10.069731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 471/952] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:09 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:07:10.783767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:10.784370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:10.790797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:10.791270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:10.791693 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:10.792370 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:10.792813 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:10.793257 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:10.807620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:10.926573 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:10.934613 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:10.936883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:10.938080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-690b683b-677a-470f-8b2d-6fbada0afb72 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.158317 Aug 11 10:07:10.938760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 482/953] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:10 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:11.089083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:11.089866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:11.096580 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:11.097157 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:11.097582 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:11.098269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:11.098921 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:11.099342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:11.246592 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:11.255078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-28b36c24-d72f-4c54-978f-58798e4f28ec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.169846 Aug 11 10:07:11.255897 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 472/954] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:11 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:11.962373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:11.962975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:11.970732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:11.971228 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:11.971642 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:11.972323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:11.972769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:11.973215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:12.189532 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:12.197967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:12.199464 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:12.201420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b32a67b4-7cf5-4245-8fda-f27c71227ea6 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.243575 Aug 11 10:07:12.208701 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 483/955] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:11 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:12.276071 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:12.276664 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:12.284028 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:12.284752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:12.285231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:12.285931 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:12.286390 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:12.286818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:12.499067 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:12.508171 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-759d6020-7868-426b-80a5-13f024f0da2d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.235521 Aug 11 10:07:12.508923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 473/956] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:12 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:13.234244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:13.235839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:13.247901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:13.251790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:13.251790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:13.251790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:13.251790 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:13.252956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:13.466354 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:13.477647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:13.478428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:13.480386 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2647451a-b633-4fc4-8bc3-c0aac409860e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.254383 Aug 11 10:07:13.488713 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 484/957] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:13 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:13.530231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:13.531593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:13.543442 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:13.544859 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:13.545409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:13.552626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:13.572832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:13.572832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:13.721930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:13.733078 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d2b15c24-c3f9-46f2-b637-5a78ce66ffe9 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.206740 Aug 11 10:07:13.747042 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 474/958] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:13 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:14.508120 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:14.508853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:14.515309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:14.515795 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:14.516225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:14.516924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:14.517544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:14.518135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:14.675817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:14.684092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:14.685773 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:14.686835 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e28ee440-3389-49da-896c-ebc54940559c tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.183670 Aug 11 10:07:14.687397 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 485/959] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:14 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:14.758069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:14.758758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:14.765672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:14.770519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:14.770519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:14.770519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:14.770519 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:14.771120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:14.772412 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:14.941972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:14.951153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-03a094bd-119f-4352-8d9f-f9d6a2d9751c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.196274 Aug 11 10:07:14.965148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 475/960] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:14 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:15.712555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:15.713596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:15.723665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:15.724151 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:15.724579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:15.725359 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:15.725878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:15.726301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:15.873337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:15.881486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:15.882982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:15.884134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d3af8015-4119-4e8b-9fbe-67fee671b56e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.175668 Aug 11 10:07:15.884689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 486/961] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:15 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:15.974169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:15.975479 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:15.982414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:15.983226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:15.984109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:15.985075 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:15.985744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:15.986398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:16.137216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:16.149557 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a7714017-3965-4b29-a3ad-c2e6fe49a44d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.179516 Aug 11 10:07:16.150181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 476/962] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:15 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:16.909090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:16.910484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:16.919229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:16.922513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:16.922513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:16.922513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:16.922513 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:16.923020 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:17.085489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:17.093340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "name": "network-vif-plugged", "status": "completed", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:17.102728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:17.104878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:17.105464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:17.105962 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:17.110194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:17.119783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4b03841e-f4c9-4036-9f5f-d14fa824d3a7 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.214896 Aug 11 10:07:17.136517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] Creating event network-vif-plugged:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:07:17.136517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-f6fbaadd-6691-496d-8905-3e774c66c44f req-e9870405-47d2-4540-9216-c1a9335e5335 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045491 Aug 11 10:07:17.136517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 477/963] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:07:17.144708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 487/964] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:16 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:17.171532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:17.174608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:17.178856 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:17.179341 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:17.179799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:17.180500 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:17.180960 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:17.181439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:17.352969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:17.362188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fcf2b55f-e29a-4d20-98d4-db6a29b9c103 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.195477 Aug 11 10:07:17.362811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 478/965] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:17 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:18.144286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:18.144953 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:18.151572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:18.152053 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:18.154421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:18.154421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:18.154421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:18.154421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:18.311023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:18.319252 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:18.320876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:18.322145 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bb236d84-c66f-4280-bb02-80d54e2882d5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.181813 Aug 11 10:07:18.322689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 488/966] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:18 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:18.384331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:18.384982 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:18.393228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:18.394674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:18.394674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:18.395378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:18.395826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:18.396240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:18.572990 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:18.582149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-56e10d3c-17b5-4e36-8c7c-b02cb698437e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.202289 Aug 11 10:07:18.583704 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 479/967] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:18 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:19.351368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:19.352154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:19.358607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:19.359097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:19.359525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:19.360219 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:19.360668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:19.361254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:19.526425 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:19.538147 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:19.540107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:19.541676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d42d825c-9b12-4baa-b261-3fb99cfd7f24 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.198316 Aug 11 10:07:19.557750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 489/968] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:19 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:19.608680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:19.609678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:19.616315 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:19.616797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:19.617295 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:19.618095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:19.618537 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:19.619000 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:19.764492 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:19.777944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6e8faed7-fd34-4bc7-901a-db082eab64a6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.174227 Aug 11 10:07:19.779543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 480/969] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:19 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:20.570555 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:20.571602 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:20.582762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:20.583558 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:20.584268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:20.585453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:20.586434 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:20.587450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:20.769508 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:20.778948 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:20.781073 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:20.782687 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ec8fd8c5-2ec4-49d6-bb48-b85efd045493 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.220080 Aug 11 10:07:20.783757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 490/970] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:20 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:20.802243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:20.803884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:20.818478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:20.818478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:20.818478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:20.818478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:20.818902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:20.818902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:20.970273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:20.978223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8c8a25ea-e478-41db-a800-f93ed9627406 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.180435 Aug 11 10:07:20.978788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 481/971] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:20 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:21.807429 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:21.808019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:21.815491 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:21.815966 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:21.816451 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:21.817205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:21.817651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:21.818068 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:21.954173 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:21.962190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:21.963767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:21.965110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-684735c1-3175-406c-8187-26b0a97a3ce9 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.161671 Aug 11 10:07:21.971540 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 491/972] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:21 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:21.999660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:22.000269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:22.006740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:22.007225 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:22.007657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:22.008365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:22.008821 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:22.009268 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:22.142834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:22.150337 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1b0abf34-ba9b-4f65-ab9c-61c6db28ecaf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.155305 Aug 11 10:07:22.150826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 482/973] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:21 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:22.988712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:22.989874 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:22.998973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:22.999724 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:23.000157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:23.000991 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:23.001884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:23.002309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:23.174924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:23.175472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:23.175587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:23.185330 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:23.186808 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:23.187745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:23.188091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:23.189220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:23.190093 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:23.190742 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:23.195205 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:23.198009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4aec61ca-795b-4ced-9ef8-77e85820ed6d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.214111 Aug 11 10:07:23.199355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 492/974] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:22 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:23.336150 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:23.343813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0097d361-3c6b-4c18-b387-958fc95e247c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.175375 Aug 11 10:07:23.344371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 483/975] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:23 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:07:24.226732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:24.226732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:24.231234 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:24.231863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:24.232407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:24.233138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:24.233586 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:24.234004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:24.371569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:24.371569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:24.375348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:24.375841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:24.376271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:24.376970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:24.378685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:24.379112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:24.405079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:24.415679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:24.421066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:24.422605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-703b2631-0a06-40a5-93f1-569582111a9e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.203284 Aug 11 10:07:24.426082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 493/976] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:24 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:24.826479 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:24.835735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b0c65801-925e-4eb9-b4fa-cf5ee9b06ba1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1359 microversion: 2.1 time: 0.472959 Aug 11 10:07:24.836626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 484/977] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:24 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1359 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:25.447858 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:25.449633 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:25.456895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:25.458335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:25.458335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:25.458585 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:25.459034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:25.459451 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:25.623965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:25.631894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:25.633412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:25.634593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0fd861df-9b37-4b25-a13c-d82978c9297d tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.192191 Aug 11 10:07:25.635138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 494/978] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:25 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:07:25.857350 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:25.857918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:25.864239 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:25.865144 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:25.865282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:25.865877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:25.866336 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:25.866757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:25.998403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.005836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-740df31d-5a68-420c-b2d3-64822e6beedb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1549 microversion: 2.1 time: 0.152342 Aug 11 10:07:26.006400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 485/979] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:25 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:26.026989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:26.027580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:26.033996 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.034478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.034907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.035749 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.036072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.036494 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.164747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.173002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c9688dc1-b093-40ab-bf94-940571ef6775 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1549 microversion: 2.1 time: 0.150008 Aug 11 10:07:26.173590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 495/980] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:26 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:26.193058 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:26.197732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.198493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Searching by: {'deleted': False, 'project_id': '93eee20443c14b739e06abe3eba34c44'} {{(pid=121196) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 11 10:07:26.205076 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.209451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.209451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.209451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.209451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.209934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.299158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.multi_cell_list [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121196) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 11 10:07:26.391852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-84036734-b360-461f-97fd-140fbbc2edec tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202529 Aug 11 10:07:26.392436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 486/981] 10.222.0.17 () {58 vars in 1125 bytes} [Thu Aug 11 10:07:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:07:26.403582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:26.404480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:26.410478 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.411074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.411571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.412317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.412830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.413356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.546668 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.554867 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fb01ea77-f6f1-4317-92c2-7f43dbdd5090 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1549 microversion: 2.1 time: 0.155133 Aug 11 10:07:26.555651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 496/982] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:26 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:07:26.659623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:26.660347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:26.666341 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.666896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.667600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.668365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:26.669848 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:26.670566 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:26.807778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.816389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.817828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:26.818978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c449cf10-d75c-4273-8e56-0268e2248277 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.164068 Aug 11 10:07:26.819555 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 487/983] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:26 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:27.005953 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "name": "network-vif-plugged", "status": "completed", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:27.016269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:27.016743 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:27.017241 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:27.029441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] Creating event network-vif-plugged:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:07:27.034503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-c19f1f08-4d11-4cf8-82c8-04c69e6baad1 req-9ed22846-d594-4d3b-bd89-57ea4b46a6ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Aug 11 10:07:27.035265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 497/984] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:07:27.846825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:27.846825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:27.857623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:27.858325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:27.858774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:27.859548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:27.859922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:27.860350 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:27.998810 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:28.007445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:28.008944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:28.010185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fc010b03-7750-4f96-a978-e6b93ad48544 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.171023 Aug 11 10:07:28.010739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 488/985] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:27 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:28.723980 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "451d1b22-6e93-408b-8a21-799e40418443"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:28.726514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:28.734109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:28.734582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:28.735009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:28.735783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:28.736239 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:28.736663 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:29.033527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:29.035661 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:29.040107 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:29.040587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:29.041036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:29.041739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:29.042197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:29.042623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:29.215072 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:29.223788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:29.225313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:29.226494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f4a3cda5-04a0-498c-bb3a-7a1170d1574e tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.197583 Aug 11 10:07:29.227041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 489/986] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:29 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:07:29.533162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:29.788958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4773afa8-4c52-469b-aea8-1f29f3c9a236 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068998 Aug 11 10:07:29.792190 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 498/987] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Aug 11 10:07:28 2022] POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments => generated 194 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:07:30.255867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:30.256455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:30.270627 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:30.275265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:30.275265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:30.275265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:30.275265 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:30.275603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:30.418220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:30.426863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:30.428380 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:30.429565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-93f5e1e1-9487-44e6-8723-0466974d1275 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1731 microversion: 2.20 time: 0.183469 Aug 11 10:07:30.430146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 490/988] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:30 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:31.454378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:31.455127 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:31.461638 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:31.462119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:31.462565 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:31.463240 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:31.463698 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:31.464119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:31.602730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:31.610775 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:31.612269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:31.613451 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9d034e1e-0970-43be-8a4e-e256bc52ddd0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1718 microversion: 2.20 time: 0.164824 Aug 11 10:07:31.614632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 499/989] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:07:31 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:07:37.956554 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:37.957185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:37.960158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:37.960387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=68 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:37.965360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:37.965849 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:37.966285 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:37.967556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:37.968016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:37.968694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:38.108761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:38.117365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a02d0db8-898e-4924-87b8-e06a8f8235cb tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1595 microversion: 2.1 time: 0.164541 Aug 11 10:07:38.118120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 491/990] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:37 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:07:40.354097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:40.365763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=48 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:40.374039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:40.374704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:40.375314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:40.399567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] Creating event network-changed:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:07:40.407525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-019b5f35-9dc1-4c3f-afa8-6be375850985 req-f337f85b-8b65-4e3c-9136-8d121db7e3d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057757 Aug 11 10:07:40.409869 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 500/991] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:07:43.206282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-475363587"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:43.206829 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:43.213556 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:43.214043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:43.214474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:43.215351 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:43.215803 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:43.216230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:43.220914 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=100 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:43.351784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.network.security_group_api [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Adding security group 1d003021-bcf1-4f2a-b831-27fe9fae8a9e to port 3a88b0bc-20d6-49a2-81d4-43b248fbc764 Aug 11 10:07:43.987243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-039f6bbb-3781-4aae-8eb6-a55fc7536a5e tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action" status: 202 len: 0 microversion: 2.1 time: 0.785649 Aug 11 10:07:43.988057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 492/992] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:07:43 2022] POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:07:43.998171 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:07:44.002473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:07:44.005772 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:44.006312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:44.006803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:44.007554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:44.008000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:44.008414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:44.022102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:07:44.033399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:07:44.039003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:07:44.039003 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:07:44.047583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] Creating event network-changed:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:07:44.054252 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-c2781173-de1c-4167-889a-a78b7733615c req-7e77dfda-110f-4d1e-8eac-0a544fe3d965 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036281 Aug 11 10:07:44.055342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 493/993] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:07:44.292806 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:07:44.302330 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7b5ee3a4-0ec0-4bea-8ce9-de5f30159572 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1759 microversion: 2.1 time: 0.309752 Aug 11 10:07:44.302903 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 501/994] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:07:43 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1759 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:01.115613 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=5 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:01.119297 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:01.120535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1277557756", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "networks": [{"uuid": "2b3a8692-db75-47d7-a650-9b407e381294"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:01.173773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] validate_networks() for [('2b3a8692-db75-47d7-a650-9b407e381294', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:08:01.525348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:08:01.525768 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:08:01.526237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:08:01.526644 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:08:01.527048 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:08:01.536080 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:01.536552 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:01.536977 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:01.537718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:01.538164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:01.538577 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:01.555056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Getting quotas for project a8690060da11478694b7110a10a00a21. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:08:01.558875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Getting quotas for user 89cc9499c67e41929b2289cfb7dd4a74 and project a8690060da11478694b7110a10a00a21. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:08:01.570465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:08:01.572749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:08:01.690238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fb2862ec-99bf-4f1f-bb19-fd20cd7a385f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575526 Aug 11 10:08:01.690976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 494/995] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:08:01.701552 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d245f399-001e-4f87-ad62-b0d726dedf29 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:01.702154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d245f399-001e-4f87-ad62-b0d726dedf29 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:01.704376 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:01.705204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:01.757676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d245f399-001e-4f87-ad62-b0d726dedf29 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:01.765087 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d245f399-001e-4f87-ad62-b0d726dedf29 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1214 microversion: 2.1 time: 0.067356 Aug 11 10:08:01.765652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 502/996] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:01 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:02.786507 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-fe0cfb5a-0f71-4b6e-9497-5c052b306be4 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:02.791475 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-fe0cfb5a-0f71-4b6e-9497-5c052b306be4 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:02.845323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-fe0cfb5a-0f71-4b6e-9497-5c052b306be4 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:02.853116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-fe0cfb5a-0f71-4b6e-9497-5c052b306be4 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1214 microversion: 2.1 time: 0.071738 Aug 11 10:08:02.853683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 495/997] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:02 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:03.876144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:03.876757 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:03.884034 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:03.884519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:03.884946 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:03.885667 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:03.886134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:03.886541 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:03.948628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:03.956703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ef7f74fe-ef0d-4e6e-9e11-d243ddab4db0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1266 microversion: 2.1 time: 0.083763 Aug 11 10:08:03.957305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 503/998] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:03 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:04.983505 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:04.989366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:04.991004 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:04.991493 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:04.991934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:04.992632 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:04.993162 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:04.993583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:05.150729 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:05.164387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-83d5d1e2-105f-4a88-8588-490e475ffd66 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.179157 Aug 11 10:08:05.164387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 496/999] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:04 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:05.898016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2516b4f7-c101-452b-82fb-14f7cb5013ca", "tag": "865be84f-70ab-4a23-aabd-6e610701ef03"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:05.910520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:05.911372 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:05.911797 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:05.937254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] Creating event network-changed:865be84f-70ab-4a23-aabd-6e610701ef03 for instance 2516b4f7-c101-452b-82fb-14f7cb5013ca on hv-cinder-81566 Aug 11 10:08:05.937254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-9a95d22e-4737-4bfe-9578-9821ac31f8a5 req-1d740498-bc7f-4210-a487-52209682e130 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039240 Aug 11 10:08:05.937254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 504/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:06.185681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:06.186665 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:06.197395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:06.197963 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:06.198568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:06.199267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:06.199725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:06.200147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:06.332866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:06.340432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e28355a4-ecab-47a1-a899-36d51ec56059 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.160482 Aug 11 10:08:06.341022 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 497/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:06 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:06.876763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:06.879662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:06.886050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:06.886529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:06.886957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:06.887644 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:06.888089 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:06.888504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:07.113922 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-184a6a73-f250-4b79-85c0-c8428f1e1c3b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action" status: 202 len: 0 microversion: 2.1 time: 0.241407 Aug 11 10:08:07.114593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 505/1002] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:08:06 2022] POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:08:07.122465 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:07.123199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:07.130317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:07.130841 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:07.131268 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:07.131948 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:07.132397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:07.132814 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:07.273397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:07.282083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f0e8c67d-1c64-4534-b214-0ead74e46936 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1751 microversion: 2.1 time: 0.163385 Aug 11 10:08:07.282652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 498/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:07 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:07.361578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:07.362872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:07.369047 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:07.369486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:07.369910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:07.370611 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:07.371056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:07.371469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:07.506147 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:07.513514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5b785bd2-b6c9-4d9b-bf5f-f505cf1b9347 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.156184 Aug 11 10:08:07.514074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 506/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:07 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:08.303988 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:08.304633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:08.311731 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:08.312227 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:08.316959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:08.316959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:08.316959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:08.316959 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:08.535427 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:08.536041 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:08.542550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:08.543030 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:08.543457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:08.544161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:08.544616 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:08.545061 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:08.678322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:08.686643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d3007b2a-73c4-4893-a10c-c77a7bacc9e4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1751 microversion: 2.1 time: 0.387044 Aug 11 10:08:08.687230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 499/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:08 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1751 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:08.964383 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-399936281", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452"}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:09.017622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] validate_networks() for None {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:08:09.172688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:09.180210 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-332f246d-1ba3-4a6e-8ddf-78c15563eb1a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.649521 Aug 11 10:08:09.193215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 507/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:08 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:09.561584 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:08:09.562088 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:08:09.562657 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:08:09.563134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:08:09.563608 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:08:09.572865 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:09.573454 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:09.573953 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:09.574972 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:09.575464 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:09.576001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:09.592915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Getting quotas for project 5a8afe85664248fd83617aab4e45c442. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:08:09.597287 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Getting quotas for user f4a8f2f254eb4bf9bb8549ab66f46d22 and project 5a8afe85664248fd83617aab4e45c442. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:08:09.608141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:08:09.610277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:08:09.710070 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:09.710711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:09.717689 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:09.718172 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:09.718880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:09.719880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:09.720428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:09.720915 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:09.750966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9f50c17c-06f2-444e-9177-dc183c0532cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790527 Aug 11 10:08:09.751837 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 500/1007] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 10:08:09.763041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9a0e8a25-48e3-4387-a5fc-47c5b6c3fb0a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:09.763791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9a0e8a25-48e3-4387-a5fc-47c5b6c3fb0a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:09.838907 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9a0e8a25-48e3-4387-a5fc-47c5b6c3fb0a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:09.850366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9a0e8a25-48e3-4387-a5fc-47c5b6c3fb0a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1214 microversion: 2.1 time: 0.090569 Aug 11 10:08:09.856385 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 501/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:09 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:09.916955 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:09.925388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7a6cfe8a-5ba5-4a8b-8681-f88b1b737365 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1751 microversion: 2.1 time: 0.221111 Aug 11 10:08:09.926162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 508/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:09 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:10.203409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:10.204039 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:10.210964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.216901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.216901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.216901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.216901 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.217310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.346788 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:10.354331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-22cf9e86-80ef-4946-a949-a0da902ccc73 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.154913 Aug 11 10:08:10.354919 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 502/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:10 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:10.609242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:10.611535 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:10.618100 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.618581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.619013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.619699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.620150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.620571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.652803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-be795ce3-27ea-45db-9001-0e5d3f65a187 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047562 Aug 11 10:08:10.653390 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 509/1011] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Aug 11 10:08:10 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:10.722320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:10.723095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:10.728923 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.729429 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.729866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.730548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.730996 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.731417 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.758836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:08:10.871837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:10.872534 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:10.895157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.895674 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.896117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.896831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:10.897356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:10.897789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:10.991263 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:10.996391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-89a82f9a-22e5-4caa-9892-f204974bf70b tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 204 len: 0 microversion: 2.20 time: 0.278586 Aug 11 10:08:10.997142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 503/1012] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Aug 11 10:08:10 2022] DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 10:08:11.002942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:11.003111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-87956fd1-fce1-458a-89db-22b32009e75a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1218 microversion: 2.1 time: 0.134505 Aug 11 10:08:11.003743 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 510/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:10 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:11.004889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:11.009982 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:11.010525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:11.012271 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.012761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.013549 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.013920 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.014365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.014781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.016755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.017292 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.017714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.019000 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.019643 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.020077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.227913 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:11.236135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:11.237998 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:11.238255 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:11.239485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e25911f3-5ef3-42a5-9a8d-560d3121a0cc tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.234828 Aug 11 10:08:11.240050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 511/1014] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:11 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:08:11.251430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-22b50163-9ff9-4d79-a320-3d8f33f42c84 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.247762 Aug 11 10:08:11.251430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 504/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:10 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:11.374745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:11.375342 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:11.381676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.382153 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.382583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.383262 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:11.383720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:11.384134 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:11.512685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:11.520882 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a9d73c0f-9962-4b2f-8932-0dc2a3a27f74 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.149715 Aug 11 10:08:11.521482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 505/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:11 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:12.023728 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:12.024323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:12.026317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:12.031542 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.045994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.045994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.045994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.045994 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.046418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.098955 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.106250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-52dca0df-fe2a-4a83-98cb-be19158567b3 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1210 microversion: 2.1 time: 0.086412 Aug 11 10:08:12.106814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 512/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:12 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:12.262683 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:12.263293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:12.268076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:12.268860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:12.269626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.270112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.270655 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.271226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.271967 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.272083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.274949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.275420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.275845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.276569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.277004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.277438 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.542535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.552838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.554969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.556141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d92851bd-a412-461d-8185-4a93681a08d8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.297366 Aug 11 10:08:12.559984 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 506/1018] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:12 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:08:12.564839 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:12.565922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:12.572663 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.573175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.575148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.575148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:12.575148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:12.575461 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:12.604223 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.613297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1bb0c75c-edf0-441c-bf53-9ef4b40562de tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.349036 Aug 11 10:08:12.613864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 513/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:12 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:12.712145 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:12.720066 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-59d4e9ff-2d66-4228-875b-9fd65fb69a06 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.158991 Aug 11 10:08:12.720652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 507/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:12 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:13.127595 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:13.128497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:13.135277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:13.135836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:13.136340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:13.137134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:13.137677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:13.138169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:13.210265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:13.217752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-8eba5529-2aae-4a4c-b63f-303b13ad46f6 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1266 microversion: 2.1 time: 0.094399 Aug 11 10:08:13.218366 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 514/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:13 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:13.425913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-76009747", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1138903170", "security_groups": [{"name": "tempest-secgroup-smoke-671395048"}], "block_device_mapping_v2": [{"uuid": "46319640-ede7-4ac8-bb6f-d2a0bd733944", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43181ee7-31a3-4e3c-b3f4-f4da182a8730"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:13.573987 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] validate_networks() for [('43181ee7-31a3-4e3c-b3f4-f4da182a8730', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:08:13.578817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:13.579414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:13.585675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:13.586220 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:13.586634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:13.587567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:13.588016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:13.588482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.211639 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:14.220314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:14.222628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:14.223889 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1cac05c4-d4ac-4601-a232-28831a51be3f tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1724 microversion: 2.20 time: 0.648997 Aug 11 10:08:14.224529 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 515/1022] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:13 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1724 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:08:14.229229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:14.230021 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:14.242166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.242652 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.243204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.243899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.244344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.244786 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.695809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:14.709989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fde9d2c3-19f5-47da-a778-67409462d87f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.479244 Aug 11 10:08:14.709989 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 516/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:14 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:14.713193 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:14.714656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:14.721848 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.722328 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.722752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.723583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.724036 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.724471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.903326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:08:14.903833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:08:14.904276 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:08:14.904676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:08:14.905527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:08:14.915258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.915744 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.916451 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.917227 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.917842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.918470 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.935097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:14.943521 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d9f3a3c0-1a66-4eab-8f70-ba8589f42873 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.235491 Aug 11 10:08:14.944341 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 517/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:14 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:14.957338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:08:14.957338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Getting quotas for user ee81d8d9cf994df68a15afe5cb9673c4 and project ea7b166d3468425ab368e369b4dd9989. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:08:14.964197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:14.965166 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:14.973465 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.977751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.977751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:14.977751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:14.977751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:14.978711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.032877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:08:15.035056 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46319640-ede7-4ac8-bb6f-d2a0bd733944',volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:08:15.089537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.103136 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e1e38b15-cc3e-421f-b2d0-b57fcacca796 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1272 microversion: 2.1 time: 0.143458 Aug 11 10:08:15.117462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 518/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:14 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:15.123017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2516b4f7-c101-452b-82fb-14f7cb5013ca", "name": "network-vif-plugged", "status": "completed", "tag": "865be84f-70ab-4a23-aabd-6e610701ef03"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:15.133227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.133705 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.134154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.138451 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:15.146692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] Creating event network-vif-plugged:865be84f-70ab-4a23-aabd-6e610701ef03 for instance 2516b4f7-c101-452b-82fb-14f7cb5013ca on hv-cinder-81566 Aug 11 10:08:15.151882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-d1d86a47-5015-400a-ba40-cf152496a3d0 req-e7e631de-3240-4f0c-9e9f-74a18bad5ff0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Aug 11 10:08:15.152651 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 519/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:15.157637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e61f10f-be72-4757-b23b-0f3e2dc4026f", "name": "network-vif-deleted", "tag": "43952e2e-82d5-4246-b8a7-4b66378e5897"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:15.167430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.168185 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.168781 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.192209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] Creating event network-vif-deleted:43952e2e-82d5-4246-b8a7-4b66378e5897 for instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f on hv-cinder-81566 Aug 11 10:08:15.198887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-44c8ae41-f826-43a8-9933-679bc8975770 req-8aac6506-71d5-49f9-a808-0023a91041a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044626 Aug 11 10:08:15.199584 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 520/1027] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:15.269112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:15.285227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:15.302650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.303141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.303582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.305179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.305831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.306664 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.350439 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.351493 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.352080 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.352690 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lazy-loading 'fault' on Instance uuid 8e61f10f-be72-4757-b23b-0f3e2dc4026f {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:08:15.411572 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.420856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.425244 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6113630b377f40eda2f8994ae69633ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e4d096ae8d4610a665f2c3f197d9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.426721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-6579e4bd-b8cd-4f1f-a1ac-086049848b55 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 200 len: 1372 microversion: 2.20 time: 0.179183 Aug 11 10:08:15.427192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 521/1028] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:15 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:08:15.509334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6140c1dc-59c7-4b8e-bf59-4f1343249ec7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.087464 Aug 11 10:08:15.516626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 508/1029] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:08:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:08:15.522837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a0702bc2-0709-4036-b6c2-661a430d66a6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:15.523833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a0702bc2-0709-4036-b6c2-661a430d66a6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:15.605499 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a0702bc2-0709-4036-b6c2-661a430d66a6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.624960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a0702bc2-0709-4036-b6c2-661a430d66a6 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1093 microversion: 2.1 time: 0.097676 Aug 11 10:08:15.624960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 522/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:15 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:15.728108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:15.728718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:15.741193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.741737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.742200 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.742903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.753399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.753694 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.966075 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:15.967844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:15.968457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:15.992550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f510cd15-ba22-4063-bd9e-2b51a88540f8 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.253861 Aug 11 10:08:15.992550 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 509/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:15 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:15.993740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.993740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.993740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:15.993740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:15.994057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:15.994057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.131491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:16.134973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:16.135119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:16.138533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.139091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.139621 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.140527 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.141226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.141554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-83cf6b9d-46ff-4fd6-818d-4d4084e260c5 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1314 microversion: 2.1 time: 0.177644 Aug 11 10:08:16.141833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.159871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 523/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:15 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:16.288940 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:16.296504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2675fc12-177f-4bf9-8cba-3a544e9af84e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.172007 Aug 11 10:08:16.297099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 510/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:16 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:16.451469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:16.452011 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:16.458265 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.458751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.459222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.459904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.460356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.460774 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.474590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f HTTP/1.1 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:08:16.476196 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:16.477899 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '8e61f10f-be72-4757-b23b-0f3e2dc4026f'} Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:16.478837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:16.480351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:16.483655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:16.483655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-aece949e-1acf-4c55-9b27-b36515d97fc3 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 404 len: 111 microversion: 2.20 time: 0.030673 Aug 11 10:08:16.483655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 524/1034] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:16 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:08:16.487561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5cdfddd7-dfa2-408d-b049-8f91951ce7c8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '.version_select at 0x7f787c161550>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:16.620469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5cdfddd7-dfa2-408d-b049-8f91951ce7c8 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542616560" status: 204 len: 0 microversion: 2.20 time: 0.137516 Aug 11 10:08:16.621246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 511/1035] 10.222.0.17 () {60 vars in 1262 bytes} [Thu Aug 11 10:08:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542616560 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 10:08:16.635579 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:16.636216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:16.642273 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.642753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.644182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.644998 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:16.645531 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:16.645950 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:16.731986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:16.740979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c457e7b0-550e-459f-9a7d-e7964cbf0593 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1143 microversion: 2.1 time: 0.109166 Aug 11 10:08:16.741685 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 525/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:16 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:17.000169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:17.000785 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:17.019477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.019981 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.020421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.022320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.022783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.023611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.169182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:17.170270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:17.177893 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.178380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.178815 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.179517 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.179988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.180396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.311968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:17.322682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3b5753f1-ad3f-49ba-8845-ad47cf70fc3c tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.326439 Aug 11 10:08:17.325685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 512/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:16 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:17.332711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:17.333758 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:17.366971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.367618 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.368292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.369167 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.369686 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.370359 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.446082 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:17.455523 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-36909ab2-7db2-4233-8b86-a53e2b6028d3 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1498 microversion: 2.1 time: 0.291598 Aug 11 10:08:17.456593 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 526/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:17 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1498 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:17.542871 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:17.546488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:17.551523 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6f9f520a-9f30-4656-b896-6cda9a3bbf11 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.223825 Aug 11 10:08:17.552366 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 513/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:17 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:17.570647 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7593b2e-955e-40b2-a044-f3166531c422", "tag": "e36ad234-3c83-461d-9f82-5b20cb020993"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:17.580157 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.581817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.582317 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.593458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] Creating event network-changed:e36ad234-3c83-461d-9f82-5b20cb020993 for instance c7593b2e-955e-40b2-a044-f3166531c422 on hv-cinder-81566 Aug 11 10:08:17.599622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-2298a206-98a8-4ea7-a620-96c11fdbb8cc req-1f4707e1-9db8-40b7-8af5-eb7574ba7855 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033383 Aug 11 10:08:17.600392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 527/1040] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:17.761740 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:17.762354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:17.769635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.770164 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.770595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.771278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:17.771728 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:17.772149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:17.835197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:17.842653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-9ffd0f9d-4e54-47a0-adf4-2567b1fae87f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1191 microversion: 2.1 time: 0.085155 Aug 11 10:08:17.843219 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 514/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:17 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:18.348368 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:18.349081 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:18.355796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.356274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.356699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.357415 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.357861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.362481 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.479762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:18.480377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:18.483896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:18.488305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.488852 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.489325 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.490050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.490496 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.494502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.519322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:08:18.695867 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:18.717280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-187281e2-0012-4a3d-aaba-4b8e636a9c97 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.370221 Aug 11 10:08:18.717280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 528/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:18 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:18.733200 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:18.733979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:18.743215 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.744230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.744667 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.745510 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.745969 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.746580 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.811958 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7c196dd6-0108-44a0-8028-5f27694dbc6d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 204 len: 0 microversion: 2.1 time: 0.336183 Aug 11 10:08:18.812452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 515/1043] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:08:18 2022] DELETE /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:08:18.821249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:18.821833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:18.827774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.828257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.828698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.829422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.829903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.831041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.845684 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f HTTP/1.1 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:18.849424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:18.854095 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '8e61f10f-be72-4757-b23b-0f3e2dc4026f'} Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:18.855010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:18.856624 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:18.858255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:18.858255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7aa67bd5-0585-4da7-bbfb-d55fb5620ea5 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 404 len: 111 microversion: 2.20 time: 0.032524 Aug 11 10:08:18.858255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 516/1044] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Aug 11 10:08:18 2022] DELETE /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:08:18.858255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:18.858255 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:18.862316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.862806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.863331 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.864029 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:18.864480 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:18.864902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:18.991062 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:18.998919 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4182f327-4de9-4369-a3c3-5ad6646b6c8e tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.280570 Aug 11 10:08:18.999498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 529/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:18 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:19.005468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:19.006242 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: 8e61f10f-be72-4757-b23b-0f3e2dc4026f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:19.015253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.016077 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.016527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.017326 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.017779 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.018809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.032967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f HTTP/1.1 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:08:19.035116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:19.036839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '8e61f10f-be72-4757-b23b-0f3e2dc4026f'} Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:19.046197 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. Aug 11 10:08:19.047832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:19.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance 8e61f10f-be72-4757-b23b-0f3e2dc4026f could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:19.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-e7193094-d9a8-4680-828b-dc3464ba1fc0 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f" status: 404 len: 111 microversion: 2.20 time: 0.035927 Aug 11 10:08:19.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 530/1046] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:18 2022] GET /compute/v2.1/servers/8e61f10f-be72-4757-b23b-0f3e2dc4026f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:08:19.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:19.049224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:19.051732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.052291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.052778 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.053538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.054032 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.054472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.145457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:19.150097 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:19.153005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-79622172-27d0-4c68-87dd-a3737c379f2f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1504 microversion: 2.1 time: 0.301949 Aug 11 10:08:19.153688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 517/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:18 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:19.159351 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5e0c64f9-3d47-4d1e-961b-488f776285bf tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1209 microversion: 2.1 time: 0.121250 Aug 11 10:08:19.160154 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 531/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:19 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:19.742292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:19.742904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:19.749363 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.749848 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.750284 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.750978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:19.751441 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:19.751868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:19.895565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:19.903934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e9653407-ca55-4993-8c7c-f6c889f7f1b4 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.165515 Aug 11 10:08:19.904539 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 518/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:19 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:20.020475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.021140 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.027587 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.031016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.031016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.031016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.031016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.031471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.173803 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.175298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.181838 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.182387 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.182807 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.183507 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.183957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.184374 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.591578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:20.598211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:20.599783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ca41cf05-5b2b-4897-b96c-a92ee4a4bf02 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.583833 Aug 11 10:08:20.603023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 532/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:20 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:20.605908 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.606738 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.607628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e81ffa36-6725-4b4b-b756-2237c217f6b2 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1504 microversion: 2.1 time: 0.437690 Aug 11 10:08:20.608497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 519/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:20 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:20.613762 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.614247 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.614714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.615417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.615872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.616379 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.623422 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.623806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.630711 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.633202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.633202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.633202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.633202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.633595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.647777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d HTTP/1.1 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:20.649378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.650842 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'c0a8db01-c3f2-467f-afd3-83ee9197d23d'} Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:20.652186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.653761 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.655329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:20.655329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-af8739ac-f21a-4d55-b29c-a3e92a17ab35 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 404 len: 111 microversion: 2.20 time: 0.041137 Aug 11 10:08:20.655329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 520/1052] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Aug 11 10:08:20 2022] DELETE /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 10:08:20.659581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.660196 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] [instance: c0a8db01-c3f2-467f-afd3-83ee9197d23d] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.666935 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.667477 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.668146 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.669653 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.670120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.670544 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.686659 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] HTTP exception thrown: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Request method failure captured: Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d HTTP/1.1 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NN0az0mpLRpaAr8fV6XZ5Dh-f6H0CpFTX6emJ7zd44Ne3SipAhis-TEx90VaJQSDo-Yc3tzSt65I_C7Sy8JW7oKIR9nMB_ByZBkjMp-RRbSTCZc94OFP61f3EWFSTUcd81lErihwkL3ME923Jr9P_sTNPSfU203UhEJdtZcVN3gYJo Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:20.688339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8e4d096ae8d4610a665f2c3f197d9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: a8e4d096ae8d4610a665f2c3f197d9b0 Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-115115186 Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 6113630b377f40eda2f8994ae69633ab Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-115115186-project Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.691631 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'c0a8db01-c3f2-467f-afd3-83ee9197d23d'} Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:20.693139 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. Aug 11 10:08:20.694944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:20.696745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] Returning 404 to user: Instance c0a8db01-c3f2-467f-afd3-83ee9197d23d could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:20.696745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ac0a06c1-d390-4a80-8ef5-737ffaf9fa63 tempest-AttachVolumeShelveTestJSON-115115186 tempest-AttachVolumeShelveTestJSON-115115186-project] 10.222.0.17 "GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d" status: 404 len: 111 microversion: 2.20 time: 0.034554 Aug 11 10:08:20.696745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 521/1053] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Aug 11 10:08:20 2022] GET /compute/v2.1/servers/c0a8db01-c3f2-467f-afd3-83ee9197d23d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 11 10:08:20.820158 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:20.828249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2d915ce2-d1ca-4335-ae5d-1a65bed01e4e tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1276 microversion: 2.1 time: 0.226273 Aug 11 10:08:20.828826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 533/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:20 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:20.926398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:20.927002 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:20.934828 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.935312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.935743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:20.936636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:20.937106 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:20.941201 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:21.245141 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:21.251646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-68d6683e-f272-4a99-8d5f-2275c5bbefe5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.329773 Aug 11 10:08:21.252642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 522/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:20 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:21.511709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bff6d0c-0ec3-4615-8950-679ce724bc9e", "tag": "8ef6c489-1e33-458d-adce-db06cb58c6e4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:21.525338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:21.526789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:21.527225 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:21.540188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] Creating event network-changed:8ef6c489-1e33-458d-adce-db06cb58c6e4 for instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e on hv-cinder-81566 Aug 11 10:08:21.545109 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-c5720169-45cd-48f1-9fc8-cab94b42c5ea req-e4a7b6b4-872d-4502-b5e2-26a8ea0a17b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037054 Aug 11 10:08:21.545914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 534/1056] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:08:21.623802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:21.623802 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:21.631116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:21.637444 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:21.638205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:21.639482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:21.639681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:21.640437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:21.642569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:21.644455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:21.652299 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:21.655013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:21.655685 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:21.667394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:21.668018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:21.668550 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:22.115777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:22.120844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:22.126702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-889fa25e-17fc-4dee-a2ce-30c996e7f05f tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1504 microversion: 2.1 time: 0.499836 Aug 11 10:08:22.129001 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 535/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:21 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:22.134143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a4c15750-e027-4940-b1cc-b1e9942014cb tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.517097 Aug 11 10:08:22.149706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:22.154213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 523/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:21 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:22.154407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:22.166462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:22.167475 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:22.168072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:22.169608 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:22.170133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:22.170661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:22.274772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:22.275953 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:22.282787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:22.283617 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:22.283859 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:22.285120 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:22.285757 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:22.286398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:22.532107 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:22.552624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-957fdd3e-a481-4741-84b6-9a82693b31b7 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.420087 Aug 11 10:08:22.554794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 536/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:22 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:22.623431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:22.633878 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e60c7db7-d6e6-462e-a211-7aa9aafbecb1 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.363978 Aug 11 10:08:22.634654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 524/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:22 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:23.150072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:23.150711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:23.156721 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.157179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.157605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.158340 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.158839 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.159440 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.172922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:23.178630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:23.185236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.189193 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.190317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.191394 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.192091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.192736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.201369 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.201856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.202279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.202891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lazy-loading 'fault' on Instance uuid 2516b4f7-c101-452b-82fb-14f7cb5013ca {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:08:23.260549 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:23.268515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-91d8aded-ac69-4649-a4bc-e6caf15b2c3c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 200 len: 1304 microversion: 2.1 time: 0.123193 Aug 11 10:08:23.269791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 537/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:23 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:23.354489 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:23.362954 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-93a79855-7cce-46d5-82b1-c732241060a4 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.194456 Aug 11 10:08:23.363620 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 525/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:23 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:23.566949 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2516b4f7-c101-452b-82fb-14f7cb5013ca", "name": "network-vif-deleted", "tag": "865be84f-70ab-4a23-aabd-6e610701ef03"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:23.575448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:23.576272 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:23.576817 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.577323 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.577742 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.584027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.585109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.585879 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.586798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.587938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.588637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.590486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] Creating event network-vif-deleted:865be84f-70ab-4a23-aabd-6e610701ef03 for instance 2516b4f7-c101-452b-82fb-14f7cb5013ca on hv-cinder-81566 Aug 11 10:08:23.596852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-c3fe6d51-7d56-475e-8a02-f339b92760c9 req-fd5fc308-e38c-406a-836b-c5aa02f42b82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Aug 11 10:08:23.597489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 538/1063] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:23.656063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:23.656974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:23.663852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.664273 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.664708 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.665429 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:23.665884 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:23.666307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:23.754433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:23.763079 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f422d6a1-68f7-4b19-9d0b-610599f3e062 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.191286 Aug 11 10:08:23.781440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 526/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:23 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:23.843410 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:23.852192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0f3adefb-0884-4b04-b0f8-d0957653333b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.200309 Aug 11 10:08:23.852910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 539/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:23 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:24.290290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:24.290949 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: 2516b4f7-c101-452b-82fb-14f7cb5013ca] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:24.297780 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.298494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.298999 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.299942 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.300389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.300811 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.315453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] HTTP exception thrown: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Request method failure captured: Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca HTTP/1.1 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NT_8pkoTkqAdNmWSHvTBVfdo2zIeaEmcK9_fZ6a-5LpwY_g_7Cw_HQ-lff2wUEblmLxfhl7aruBM5_GCwj2A3EpZxxRIPN-44ngMZad8Oj-u4GkcsS470ySyhrMJ8uEVTgJO_mUlNKKCIoevdju78YOmW-AdPx6qG3UiP9SY_TteuY Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: a8690060da11478694b7110a10a00a21 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesActionsTest-237190587 Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:24.317185 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8690060da11478694b7110a10a00a21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8690060da11478694b7110a10a00a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8690060da11478694b7110a10a00a21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8690060da11478694b7110a10a00a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesActionsTest-237190587 Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: a8690060da11478694b7110a10a00a21 Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesActionsTest-237190587 Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesActionsTest-237190587-project Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 89cc9499c67e41929b2289cfb7dd4a74 Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesActionsTest-237190587-project Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. Aug 11 10:08:24.318671 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '2516b4f7-c101-452b-82fb-14f7cb5013ca'} Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:24.319553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. Aug 11 10:08:24.320834 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:24.322031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Returning 404 to user: Instance 2516b4f7-c101-452b-82fb-14f7cb5013ca could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:24.322031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-37e3bb04-0dfb-414e-92ed-abe055597e2b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca" status: 404 len: 111 microversion: 2.1 time: 0.032143 Aug 11 10:08:24.327405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 527/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:24 2022] GET /compute/v2.1/servers/2516b4f7-c101-452b-82fb-14f7cb5013ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:08:24.384112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:24.384699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:24.390976 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.391453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.391887 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.392603 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.393135 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.393568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.427223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2014422632", "imageRef": "1c6cdbfc-e5f4-493e-9414-485b44da533c", "flavorRef": "452", "networks": [{"uuid": "2b3a8692-db75-47d7-a650-9b407e381294"}]}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:24.486722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.network.neutron [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] validate_networks() for [('2b3a8692-db75-47d7-a650-9b407e381294', None, None, None, None, None)] {{(pid=121196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:08:24.684771 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:24.688877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:24.694608 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-81e02451-4b1c-40cf-8421-a74e4c9dc39c tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.314395 Aug 11 10:08:24.710024 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 540/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:24 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:24.730122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7593b2e-955e-40b2-a044-f3166531c422", "name": "network-vif-plugged", "status": "completed", "tag": "e36ad234-3c83-461d-9f82-5b20cb020993"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:24.748811 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.749512 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.753268 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.777374 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] Creating event network-vif-plugged:e36ad234-3c83-461d-9f82-5b20cb020993 for instance c7593b2e-955e-40b2-a044-f3166531c422 on hv-cinder-81566 Aug 11 10:08:24.785033 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-961e20c7-51e4-4105-bc5e-23b65529f4aa req-20dfb6e5-35f7-4f07-bda9-8cf0f7ab4265 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058937 Aug 11 10:08:24.785783 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 541/1068] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:08:24.795315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:24.796076 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:24.803254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.803974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.804605 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.805557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:24.806224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:24.806871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:24.928149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=6 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:24.960776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=22 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:25.068960 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:25.076432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-797dd23b-f5c7-4ae2-9e11-63e9ece73092 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.285096 Aug 11 10:08:25.076996 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 542/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:24 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:25.083355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:25.084421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:25.093004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.093509 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.094305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.095011 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.095459 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.096407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.128765 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Flavor limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:08:25.129369 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Image limits 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:08:25.130027 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Flavor pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:08:25.130439 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Image pref 0:0:0 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:08:25.130844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.virt.hardware [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:08:25.139974 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.140420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.140853 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.141597 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.142044 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.151630 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.160357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Getting quotas for project a8690060da11478694b7110a10a00a21. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:08:25.164560 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Getting quotas for user 89cc9499c67e41929b2289cfb7dd4a74 and project a8690060da11478694b7110a10a00a21. Resources: {'instances', 'cores', 'ram'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:08:25.176440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Going to run 1 instances... {{(pid=121196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:08:25.178713 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c6cdbfc-e5f4-493e-9414-485b44da533c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:08:25.300784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b860443f-ff7c-49f5-8160-1a19d5dcb37d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877550 Aug 11 10:08:25.301512 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 528/1070] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 10:08:25.312311 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-b0b19f8c-e16c-4cec-bb5a-821458c991e0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:25.313175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-b0b19f8c-e16c-4cec-bb5a-821458c991e0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:25.313502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:25.323650 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2d07c97d-0bae-4728-8e12-5bc5a538b974 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.245425 Aug 11 10:08:25.324615 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 543/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:25 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:25.373102 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-b0b19f8c-e16c-4cec-bb5a-821458c991e0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:25.381293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-b0b19f8c-e16c-4cec-bb5a-821458c991e0 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1214 microversion: 2.1 time: 0.072633 Aug 11 10:08:25.382516 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 529/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:25 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:25.716902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:25.717607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:25.721251 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:25.729072 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.729631 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.730262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.731101 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:25.731716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:25.732312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:25.870031 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:25.879507 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-81c28cfa-257d-4604-9ecd-bdd8edfd6f95 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1314 microversion: 2.1 time: 0.166451 Aug 11 10:08:25.894837 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 544/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:25 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:26.100660 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:26.101304 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:26.107395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.107873 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.108303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.108995 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.109517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.109892 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.249508 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:26.257140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7d37a196-c6a1-400b-8d2c-181cf9c23ffe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.160333 Aug 11 10:08:26.257698 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 530/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:26 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:26.349880 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:26.350755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:26.356768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.357462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.358585 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.358710 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.359083 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.359505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.402709 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:26.403305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:26.409970 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.410452 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.410926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.411623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.412070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.412488 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.483491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:26.491741 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a7d18f75-d212-4e74-9eb3-61481bf9c3e6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1218 microversion: 2.1 time: 0.092955 Aug 11 10:08:26.492310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 531/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:26 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:26.527904 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:26.537748 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-20a99099-c2c3-4f74-be2a-b4836d395cbf tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1756 microversion: 2.1 time: 0.192539 Aug 11 10:08:26.549966 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 545/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:26 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:26.901623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:26.902283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:26.909211 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.909686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.910110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:26.910792 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:26.911243 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:26.911661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.027274 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5ef3c84b-46f6-4ee7-8ba6-aa1ad66fc7fb tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Action: 'create', calling method: .version_select at 0x7f787e088d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1638221259", "metadata": {"Type": "work"}}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:27.046564 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:27.055194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5c0193bb-c696-4064-8901-6d258b08a954 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1463 microversion: 2.1 time: 0.157402 Aug 11 10:08:27.055852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 546/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:26 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:27.103615 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.108957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:27.108957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=100 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:27.112418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.112981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.113484 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.114392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.115016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.115607 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.143620 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:08:27.522039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c8a57826-fd83-4170-b00f-65916c126d7a tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 204 len: 0 microversion: 2.1 time: 0.422971 Aug 11 10:08:27.522810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 547/1078] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:08:27 2022] DELETE /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:08:27.528453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.529291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:27.535291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.535805 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.536231 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.536910 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.537386 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.537803 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.668769 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5ef3c84b-46f6-4ee7-8ba6-aa1ad66fc7fb tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.786898 Aug 11 10:08:27.669557 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 532/1079] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Aug 11 10:08:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 788 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 11 10:08:27.680017 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.680216 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:27.680626 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:27.688179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bf33c54b-124a-4e6f-8bdc-14299445e36a tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.164253 Aug 11 10:08:27.688761 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 548/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:27 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:27.688924 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.689293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.689848 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.690654 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.691199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.691646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.693666 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.694253 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:27.700485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.701195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.701810 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.702653 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.703262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.703836 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.764416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:27.773415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d83921b5-c9ff-4de3-b8fa-126e7bbb238b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1210 microversion: 2.1 time: 0.097380 Aug 11 10:08:27.773992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 533/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:27 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:27.779190 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.779930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:27.792565 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.793104 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.793548 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.794300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:27.794783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:27.795211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:27.799633 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:27.902240 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:27.910357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d0643558-9994-4ff3-9dfe-5bb4aa3eee81 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1469 microversion: 2.1 time: 0.220190 Aug 11 10:08:27.910931 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 549/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:27 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:27.915559 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c92c9d56-236d-48c1-8639-a06d1cb0b655 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f787c2ba160>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:27.962127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:27.966516 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c92c9d56-236d-48c1-8639-a06d1cb0b655 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 200 len: 353 microversion: 2.1 time: 0.054560 Aug 11 10:08:27.967094 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 550/1083] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:08:27 2022] GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:27.970326 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-577e03cc-0581-40ed-a999-17c70f14e643 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1759 microversion: 2.1 time: 0.195273 Aug 11 10:08:27.971125 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 534/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:27 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:28.708556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:28.709183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:28.715418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:28.715896 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:28.716327 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:28.717007 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:28.717482 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:28.717898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:28.795354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:28.795964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:28.803992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:28.804482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:28.804917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:28.805679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:28.806133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:28.812347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:29.063867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:29.072401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-84223674-d8ad-46a9-b97f-ec23f0e97b5e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1266 microversion: 2.1 time: 0.281332 Aug 11 10:08:29.073094 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 535/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:28 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:29.077809 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:29.078404 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:29.085500 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:29.085992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:29.087569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:29.087569 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:29.087777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:29.088016 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:29.127816 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:29.135734 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ea2da0cc-ce6c-4c48-bc03-5e1fe0ec038d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.431231 Aug 11 10:08:29.136312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 551/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:28 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:29.145461 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-54a51fa6-baef-4972-84f7-8e89f35619d8 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f787c1e9160>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:29.195568 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-54a51fa6-baef-4972-84f7-8e89f35619d8 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 200 len: 354 microversion: 2.1 time: 0.058222 Aug 11 10:08:29.196213 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 552/1087] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:08:29 2022] GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:29.208809 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-37b5d9a2-c35b-492c-9136-8c5b98f506e1 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f7880aada60>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:29.234433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:29.242716 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-108bd74d-d1b1-445e-9893-d225f1deb849 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1469 microversion: 2.1 time: 0.168508 Aug 11 10:08:29.243401 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 536/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:29 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:29.259067 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-37b5d9a2-c35b-492c-9136-8c5b98f506e1 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 200 len: 354 microversion: 2.1 time: 0.054553 Aug 11 10:08:29.259569 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 553/1089] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:08:29 2022] GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:08:29.277323 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-66c3a452-ad6c-407c-bd25-d2457e768ae4 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f787c143af0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:29.452057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-66c3a452-ad6c-407c-bd25-d2457e768ae4 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 202 len: 0 microversion: 2.1 time: 0.178418 Aug 11 10:08:29.452625 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 537/1090] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Aug 11 10:08:29 2022] DELETE /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:08:29.461329 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3273b1aa-e4b2-4e41-ac53-9ba342ddd78d tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f787c0e8430>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:29.508752 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3273b1aa-e4b2-4e41-ac53-9ba342ddd78d tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 200 len: 353 microversion: 2.1 time: 0.051196 Aug 11 10:08:29.509412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 554/1091] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:08:29 2022] GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:30.095018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:30.095739 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:30.101885 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.102367 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.102798 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.103485 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.103934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.104353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.157827 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:30.158986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:30.165932 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.166418 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.166855 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.167551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.168008 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.168437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.179032 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:30.197718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-03d6c40a-6baa-4950-9803-9e1eb74d3be6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1266 microversion: 2.1 time: 0.107255 Aug 11 10:08:30.198360 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 538/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:30 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:30.264100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:30.264812 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:30.271154 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.271734 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.272443 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.273219 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.273736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.274226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.565801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:30.575301 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a20e3d75-941c-4dac-b93f-051cc86e297c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.422136 Aug 11 10:08:30.575883 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 555/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:30 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:30.580373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ea24342-82b2-4a7b-bded-a4869af69340 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Calling method '.version_select at 0x7f7880aad9d0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:30.608856 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-0ea24342-82b2-4a7b-bded-a4869af69340 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] HTTP exception thrown: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ea24342-82b2-4a7b-bded-a4869af69340 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Request method failure captured: Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 HTTP/1.1 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NUa1Sqr_jobECkRgRbzfAgNZ5k0u-v4ya2uJygD8KSTCLvZQiK_StKhCoZYg-x1vrAYKk-BtycqpDfPbrujmz_MiXZhOsWSXLFZ4N1GWwqQgbCebVgKzyACzAFBSnZQDRJVfc2A3u0shuF5G1qZ188gvH2Dj2WHCqZyr7r1MdpQrOQ Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 7424f67925334b2eb0a85057a44b9526 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-VolumesGetTestJSON-960756822 Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:08:30.611063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7424f67925334b2eb0a85057a44b9526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7424f67925334b2eb0a85057a44b9526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7424f67925334b2eb0a85057a44b9526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7424f67925334b2eb0a85057a44b9526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-VolumesGetTestJSON-960756822 Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 7424f67925334b2eb0a85057a44b9526 Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-VolumesGetTestJSON-960756822 Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-VolumesGetTestJSON-960756822-project Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 28a156e1ab8942438d51f7148ac75b85 Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-VolumesGetTestJSON-960756822-project Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': 'a496ef35-a02b-4eb8-903e-5429d0337120'} Aug 11 10:08:30.613458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. (HTTP 404) (Request-ID: req-153f2336-bd6b-4232-aa7e-b3d8f37f58c9) Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:30.614520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 10:08:30.615814 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 10:08:30.620511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ea24342-82b2-4a7b-bded-a4869af69340 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] Returning 404 to user: Volume a496ef35-a02b-4eb8-903e-5429d0337120 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0ea24342-82b2-4a7b-bded-a4869af69340 tempest-VolumesGetTestJSON-960756822 tempest-VolumesGetTestJSON-960756822-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120" status: 404 len: 109 microversion: 2.1 time: 0.036369 Aug 11 10:08:30.622453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 556/1094] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Aug 11 10:08:30 2022] GET /compute/v2.1/os-volumes/a496ef35-a02b-4eb8-903e-5429d0337120 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:08:30.650755 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:30.661854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-40978f21-8b6b-4b92-a93a-5350831ff522 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1469 microversion: 2.1 time: 0.401831 Aug 11 10:08:30.663069 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 539/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:30 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:30.864480 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7593b2e-955e-40b2-a044-f3166531c422", "name": "network-vif-deleted", "tag": "e36ad234-3c83-461d-9f82-5b20cb020993"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:30.891670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:30.892198 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:30.893057 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:30.918622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] Creating event network-vif-deleted:e36ad234-3c83-461d-9f82-5b20cb020993 for instance c7593b2e-955e-40b2-a044-f3166531c422 on hv-cinder-81566 Aug 11 10:08:30.921863 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-33f96898-4a83-4e02-b7e3-83d9ef66189e req-a0c92cac-3a0b-45a5-8231-969287900c77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061596 Aug 11 10:08:30.922890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 557/1096] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:31.218375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:31.219166 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:31.226313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.226791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.227226 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.230220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.230220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.230220 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.296875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:31.306322 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-aec5900e-7617-41ca-aede-bb638bce6d2d tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1272 microversion: 2.1 time: 0.091731 Aug 11 10:08:31.307540 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 540/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:31 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:31.598105 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:31.598791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:31.605539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.606016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.606439 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.608538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.608538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.608538 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.684246 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:31.685339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:31.691600 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.692086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.692561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.693283 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.693732 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.694149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.729414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:31.729903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:31.730374 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:31.730876 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lazy-loading 'fault' on Instance uuid c7593b2e-955e-40b2-a044-f3166531c422 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:08:31.812396 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a8f2f254eb4bf9bb8549ab66f46d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8afe85664248fd83617aab4e45c442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:31.820756 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c4246190-abb1-4106-898a-8d62071589d9 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 200 len: 1304 microversion: 2.1 time: 0.140548 Aug 11 10:08:31.833230 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 541/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:31 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:31.853937 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:31.862975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f3555e98-501e-4b88-a760-883aa1f5a66f tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.269299 Aug 11 10:08:31.876118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 558/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:31 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:32.326553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:32.327269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:32.333602 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.334151 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.337725 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.338583 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.339121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.339611 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.494486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:32.501976 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-92ce23f8-8633-4a9a-8f6c-9f58738533f7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.179256 Aug 11 10:08:32.502693 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 542/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:32 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:32.685871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6d0c-0ec3-4615-8950-679ce724bc9e", "name": "network-vif-plugged", "status": "completed", "tag": "8ef6c489-1e33-458d-adce-db06cb58c6e4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:32.696119 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.696691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.697150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.708924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] Creating event network-vif-plugged:8ef6c489-1e33-458d-adce-db06cb58c6e4 for instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e on hv-cinder-81566 Aug 11 10:08:32.714016 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-545142c4-76b9-4917-8b1d-0b792a9c743d req-83434aaf-780b-44ea-a952-07f056ca04fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Aug 11 10:08:32.714807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 559/1101] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:32.843497 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:32.844447 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] [instance: c7593b2e-955e-40b2-a044-f3166531c422] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:32.850705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.851314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.851754 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.852457 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.852937 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.853391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.868127 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] HTTP exception thrown: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Request method failure captured: Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 HTTP/1.1 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NUFU0gw7IUABmfU07M_tah89V-yw5DfZ_0hHKdYRe6p1D0bPRGsr5gGz1jondzGfrXdwKYBXd63DTRINR7wl1xo3HA3pWct7zFrZ2oQqZm0rfzqgu2YOkgEStHTd4e4eO81OAJZgUHaLwl50l6R_TcRUTMJnM3yyZhwA3F77igZ43s Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 5a8afe85664248fd83617aab4e45c442 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesNegativeTest-51571806 Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:32.869696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a8afe85664248fd83617aab4e45c442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a8afe85664248fd83617aab4e45c442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5a8afe85664248fd83617aab4e45c442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5a8afe85664248fd83617aab4e45c442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesNegativeTest-51571806 Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 5a8afe85664248fd83617aab4e45c442 Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesNegativeTest-51571806 Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesNegativeTest-51571806-project Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: f4a8f2f254eb4bf9bb8549ab66f46d22 Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesNegativeTest-51571806-project Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. Aug 11 10:08:32.871100 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'c7593b2e-955e-40b2-a044-f3166531c422'} Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:32.871898 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. Aug 11 10:08:32.873231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:32.874532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] Returning 404 to user: Instance c7593b2e-955e-40b2-a044-f3166531c422 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:32.874532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-755e5304-0dd5-4524-b88c-9d24931d3c80 tempest-VolumesNegativeTest-51571806 tempest-VolumesNegativeTest-51571806-project] 10.222.0.17 "GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422" status: 404 len: 111 microversion: 2.1 time: 0.031460 Aug 11 10:08:32.874532 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 543/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:32 2022] GET /compute/v2.1/servers/c7593b2e-955e-40b2-a044-f3166531c422 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:08:32.887658 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:32.887658 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:32.909098 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.909583 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.910019 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.910714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.911164 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.911581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.943545 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5fab74-a462-4982-9e0d-cd870536a52f", "tag": "9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:32.956810 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:32.958672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:32.959296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:32.972915 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] Creating event network-changed:9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97 for instance bd5fab74-a462-4982-9e0d-cd870536a52f on hv-cinder-81566 Aug 11 10:08:32.980061 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-5c459b48-0118-420a-b922-d1bd2a5482a8 req-3a35322e-33e7-481a-b4f4-1c6abfdb31b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042555 Aug 11 10:08:32.981183 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 544/1103] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:08:33.192658 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:33.203925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-086836a0-4bab-42a4-a9ef-04cb3277873c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.322049 Aug 11 10:08:33.220450 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 560/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:32 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:33.525030 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:33.525749 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:33.533992 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:33.534483 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:33.534933 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:33.535670 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:33.536121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:33.536679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:33.681535 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:33.692114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1e746b6d-f8dc-4f41-bff3-0ef8fa263d0e tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.171927 Aug 11 10:08:33.692818 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 545/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:33 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:34.228394 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:34.228999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:34.235596 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:34.236075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:34.236497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:34.237208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:34.238275 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:34.238747 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:34.379182 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:34.386771 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-88a63e50-2d59-482a-b3d9-f91d00e4d5db tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1264 microversion: 2.1 time: 0.162421 Aug 11 10:08:34.387346 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 561/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:34 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:34.713250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:34.714005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:34.724043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:34.724043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:34.724043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:34.724043 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:34.724389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:34.724662 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:34.858735 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:34.867432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-7e7bc13c-4a91-4bf7-bf36-b1168123acdc tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.158288 Aug 11 10:08:34.867938 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 546/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:34 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:35.412832 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:35.413471 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:35.424527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.425248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.425759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.426527 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.426987 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.427629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.657417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:35.661871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:35.667303 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4aead365-6fd9-4b52-a8cc-85b4d700cd6c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1450 microversion: 2.1 time: 0.261809 Aug 11 10:08:35.667472 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 562/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:35 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1450 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:35.687273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:35.690763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:35.690763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:35.690763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=8 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:35.695159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.695641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.696065 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.696748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.697232 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.697651 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.889606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:35.890195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:35.900369 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.900851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.901381 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.902013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:35.902525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:35.902951 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:35.920547 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:35.928433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-02dbdace-0b83-44da-84ae-c54a0ef06a60 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1450 microversion: 2.1 time: 0.244910 Aug 11 10:08:35.929099 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 547/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:35 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1450 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:36.090318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:36.098882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-16f9696d-00de-4196-80c6-5b662d40c6ca tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.213289 Aug 11 10:08:36.099445 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 563/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:35 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:08:37.121639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:37.122257 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:37.134674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:37.135170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:37.135640 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:37.137133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:37.137601 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:37.140057 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:37.313159 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:37.326389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c9925eb9-1efb-49ff-a008-29a9113a8179 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.209883 Aug 11 10:08:37.335023 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 548/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:37 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:38.114824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bff6d0c-0ec3-4615-8950-679ce724bc9e", "tag": "8ef6c489-1e33-458d-adce-db06cb58c6e4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:38.125362 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:38.131353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:38.131353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:38.138823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] Creating event network-changed:8ef6c489-1e33-458d-adce-db06cb58c6e4 for instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e on hv-cinder-81566 Aug 11 10:08:38.144479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-90533d14-9be3-4162-ab0d-e75656d748da req-dd66eb2e-6f0d-42fe-a24b-eb3229e77259 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 Aug 11 10:08:38.145204 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 564/1112] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:38.348530 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:38.349438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:38.356939 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:38.359133 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:38.359590 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:38.360372 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:38.360835 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:38.361300 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:38.570748 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:38.582168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6948c28a-0a14-41bc-9b0e-9a0d78467168 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.237976 Aug 11 10:08:38.583414 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 549/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:38 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:38.795711 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5fab74-a462-4982-9e0d-cd870536a52f", "name": "network-vif-plugged", "status": "completed", "tag": "9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:38.808142 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:38.808626 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:38.809090 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:38.822453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] Creating event network-vif-plugged:9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97 for instance bd5fab74-a462-4982-9e0d-cd870536a52f on hv-cinder-81566 Aug 11 10:08:38.828250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-17db9514-1c7a-4cc7-86df-fbf7775c37f2 req-fb19eeb1-c7cd-4a5d-a727-04305fd7ed1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Aug 11 10:08:38.830004 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 565/1114] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:08:39.603142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:39.603743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:39.610591 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:39.611075 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:39.611517 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:39.612718 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:39.613216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:39.613643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:39.758513 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:39.766606 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-331b012d-909a-48ff-a199-1728673901c7 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1314 microversion: 2.1 time: 0.166992 Aug 11 10:08:39.767123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 550/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:39 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:40.787935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:40.788614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:40.795114 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:40.795590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:40.796015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:40.796722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:40.797195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:40.797618 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:40.930291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:40.937767 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0f19f893-0821-4dd5-84b2-16b32063bc3b tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1498 microversion: 2.1 time: 0.154079 Aug 11 10:08:40.938361 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 566/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:40 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:41.930357 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:41.930870 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:41.937314 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:41.937791 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:41.938216 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:41.938899 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:41.939346 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:41.939763 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:41.965637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:08:42.007559 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:42.310334 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-4e8bcd82-f3bd-456d-9b33-f8425367db08 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 204 len: 0 microversion: 2.1 time: 0.383677 Aug 11 10:08:42.310947 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 551/1117] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:08:41 2022] DELETE /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:08:42.319496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:42.322028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:42.329928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:42.330411 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:42.330844 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:42.331567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:42.332010 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:42.332426 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:42.483846 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:42.492322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-fe8f3e6c-3d4c-48b3-8345-aec64de660b6 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1504 microversion: 2.1 time: 0.176933 Aug 11 10:08:42.492890 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 567/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:42 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:43.515824 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:43.516438 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:43.521430 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:43.524799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:43.525312 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:43.525747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:43.526453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:43.526902 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:43.527320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:43.678720 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:43.686469 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1424ce4a-895f-4de2-8b35-d7fa82170f8c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1504 microversion: 2.1 time: 0.175649 Aug 11 10:08:43.687119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 552/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:43 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:44.710731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:44.711402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:44.722895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:44.724504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:44.725148 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:44.726163 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:44.726623 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:44.727092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:44.814784 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5fab74-a462-4982-9e0d-cd870536a52f", "name": "network-vif-deleted", "tag": "9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:08:44.816404 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:44.824435 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-1bb613ac-374d-4ceb-b5e4-6929cb27817c tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1462 microversion: 2.1 time: 0.118737 Aug 11 10:08:44.825117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 568/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:44 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:44.827377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:44.827884 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:44.828670 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:44.841005 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] Creating event network-vif-deleted:9c0cd7f0-c82c-4bf2-9886-b38bc4ff5a97 for instance bd5fab74-a462-4982-9e0d-cd870536a52f on hv-cinder-81566 Aug 11 10:08:44.846170 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-891ec4cb-ba72-4b44-b33f-f8e3674a3e0c req-ca54452a-135b-4ec4-a94e-4d246aeda64f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 11 10:08:44.847301 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 553/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:08:45.847430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:45.847947 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:45.854416 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:45.854888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:45.855393 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:45.856075 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:45.856525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:45.856935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:45.892704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:45.893309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:45.893732 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:45.894124 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lazy-loading 'fault' on Instance uuid bd5fab74-a462-4982-9e0d-cd870536a52f {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:08:45.936898 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc9499c67e41929b2289cfb7dd4a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8690060da11478694b7110a10a00a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:08:45.943882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3316e177-bfa4-40ad-83e2-d124e9bc5f2a tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 200 len: 1304 microversion: 2.1 time: 0.100879 Aug 11 10:08:45.944436 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 569/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:45 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:08:46.967083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:08:46.967772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] [instance: bd5fab74-a462-4982-9e0d-cd870536a52f] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:08:46.974581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:46.975062 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:46.975553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:46.976240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:08:46.976692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:08:46.977143 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:08:46.990969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] HTTP exception thrown: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Request method failure captured: Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f HTTP/1.1 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NT_8pkoTkqAdNmWSHvTBVfdo2zIeaEmcK9_fZ6a-5LpwY_g_7Cw_HQ-lff2wUEblmLxfhl7aruBM5_GCwj2A3EpZxxRIPN-44ngMZad8Oj-u4GkcsS470ySyhrMJ8uEVTgJO_mUlNKKCIoevdju78YOmW-AdPx6qG3UiP9SY_TteuY Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: a8690060da11478694b7110a10a00a21 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-VolumesActionsTest-237190587 Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:08:46.992603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8690060da11478694b7110a10a00a21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a8690060da11478694b7110a10a00a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a8690060da11478694b7110a10a00a21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a8690060da11478694b7110a10a00a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-VolumesActionsTest-237190587 Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: a8690060da11478694b7110a10a00a21 Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-VolumesActionsTest-237190587 Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-VolumesActionsTest-237190587-project Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 89cc9499c67e41929b2289cfb7dd4a74 Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-VolumesActionsTest-237190587-project Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. Aug 11 10:08:46.994290 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'bd5fab74-a462-4982-9e0d-cd870536a52f'} Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:08:46.995867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. Aug 11 10:08:46.997978 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:08:47.000968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] Returning 404 to user: Instance bd5fab74-a462-4982-9e0d-cd870536a52f could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:08:47.000968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-458e0344-2126-4e9b-8a3f-0b5e0eafbd91 tempest-VolumesActionsTest-237190587 tempest-VolumesActionsTest-237190587-project] 10.222.0.17 "GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f" status: 404 len: 111 microversion: 2.1 time: 0.031626 Aug 11 10:08:47.000968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 554/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:08:46 2022] GET /compute/v2.1/servers/bd5fab74-a462-4982-9e0d-cd870536a52f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:09:07.063258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-475363587"}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:09:07.065791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:07.069694 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:07.072578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=36 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:07.083306 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:07.084847 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:07.085574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:07.086641 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:07.087581 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:07.088430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:07.339018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.network.security_group_api [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Removing security group 1d003021-bcf1-4f2a-b831-27fe9fae8a9e from port 3a88b0bc-20d6-49a2-81d4-43b248fbc764 Aug 11 10:09:07.838551 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0abd6e8a-4305-41a5-a3d4-46260f941ef7 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action" status: 202 len: 0 microversion: 2.1 time: 0.788430 Aug 11 10:09:07.840477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 570/1124] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:09:07 2022] POST /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:09:07.856213 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:09:07.872652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:07.873825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:07.888458 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:07.891989 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:07.893442 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:07.928303 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] Creating event network-changed:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:09:07.971181 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-0c666af3-712d-48ee-8901-66542ec86e33 req-b3be135a-6a19-4796-a799-90625d301d9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112615 Aug 11 10:09:07.974764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 555/1125] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:09:09.739140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:09:09.739923 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:09.740326 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:09.753777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:09.753777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:09.753777 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:09.756819 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:09.757485 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:09.758009 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:09.758870 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:09.759502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:09.759997 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:09.765629 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] Creating event network-changed:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:09:09.771243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-2e23b2fd-1ed9-4951-bd65-1a8cbefd6e8b req-24bcc255-32c0-40ac-8c6e-9be6beeef6ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037845 Aug 11 10:09:09.776250 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 556/1126] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:09:09.863254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lazy-loading 'services' on Instance uuid f1cf162e-835d-4ffd-a9a5-bddc1f373e23 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:09:10.145201 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3c180340-fa8a-42e9-be40-e1e2b72fd02d tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments/451d1b22-6e93-408b-8a21-799e40418443" status: 202 len: 0 microversion: 2.1 time: 0.411511 Aug 11 10:09:10.147194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 571/1127] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:09:09 2022] DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments/451d1b22-6e93-408b-8a21-799e40418443 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:09:10.161377 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:10.163561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:10.183386 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:10.184205 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:10.196504 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:10.199289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:10.200212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:10.201729 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:10.262689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d2a39d9d-42a0-4102-bf52-a2948d3a809b tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103147 Aug 11 10:09:10.262689 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 557/1128] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:09:10 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:09:11.276355 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:11.278878 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:11.287452 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:11.287861 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:11.288297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:11.289002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:11.291479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:11.295504 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:11.335146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c2ffeab4-1e8c-41ba-ace3-0ab30a3f43b6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064696 Aug 11 10:09:11.335740 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 572/1129] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:09:11 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:09:12.352014 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:12.355909 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:12.367015 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:12.367752 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:12.368309 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:12.369571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:12.370175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:12.370825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:12.414348 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-31f7137f-f594-4efb-b0ea-c26b45f6fc45 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069394 Aug 11 10:09:12.415820 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 558/1130] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Aug 11 10:09:12 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 10:09:12.431612 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:12.432086 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:12.440988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:12.441958 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:12.442661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:12.449676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:12.450524 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:12.451169 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:12.572402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] HTTP exception thrown: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 is not attached to volume 451d1b22-6e93-408b-8a21-799e40418443 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Request method failure captured: Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments/451d1b22-6e93-408b-8a21-799e40418443 HTTP/1.1 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NShDHmNXj6oxAloYATig9Pcp9U0TdgU9qV3NxFLz4r4jBfRF1Ou9G6BbxUnRaysBFnC39RPtf0qUIzvMfxo7HWniQYB07-d5p598Xn2ZADKzM2Y5bui1UvGkxmGnwHm38DJId7gn7X820V9FO97LPpZAGQ5k4TWEHa-6J5hR_pV35M Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 93eee20443c14b739e06abe3eba34c44 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:09:12.577274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_93eee20443c14b739e06abe3eba34c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 93eee20443c14b739e06abe3eba34c44 Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-TestMinimumBasicScenario-1358197335-project Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: 1f3839edcb09423b8b4885dffbd87af9 Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-TestMinimumBasicScenario-1358197335-project Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:09:12.578972 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 is not attached to volume 451d1b22-6e93-408b-8a21-799e40418443 Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'server_id': 'f1cf162e-835d-4ffd-a9a5-bddc1f373e23', 'id': '451d1b22-6e93-408b-8a21-799e40418443'} Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 451d1b22-6e93-408b-8a21-799e40418443. Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:09:12.580589 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 is not attached to volume 451d1b22-6e93-408b-8a21-799e40418443 Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 is not attached to volume 451d1b22-6e93-408b-8a21-799e40418443 Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:09:12.582079 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Returning 404 to user: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 is not attached to volume 451d1b22-6e93-408b-8a21-799e40418443 {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:09:12.583233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-346d7225-f317-467d-86f4-02ae6fa2d62f tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments/451d1b22-6e93-408b-8a21-799e40418443" status: 404 len: 154 microversion: 2.1 time: 0.152857 Aug 11 10:09:12.583233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 573/1131] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Aug 11 10:09:12 2022] DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23/os-volume_attachments/451d1b22-6e93-408b-8a21-799e40418443 => generated 154 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:09:13.918269 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:13.919034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:13.927126 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:13.927641 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:13.928103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:13.929561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:13.930040 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:13.930522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:13.971922 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:09:14.335355 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6f457e4c-c0b8-4428-a3e2-8bafddca9201 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 204 len: 0 microversion: 2.1 time: 0.420808 Aug 11 10:09:14.336034 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 559/1132] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:09:13 2022] DELETE /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 10:09:14.346466 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:14.347402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:14.354519 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:14.355002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:14.355432 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:14.356141 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:14.356588 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:14.357002 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:14.501316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:09:14.510330 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-13a7c04b-afed-47a2-9f74-ddf6467e0411 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1555 microversion: 2.1 time: 0.169487 Aug 11 10:09:14.510909 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 574/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:09:14 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:09:15.535436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:15.536130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:15.546010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:15.546010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:15.546010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:15.546010 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:15.546603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:15.546603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:15.695667 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:09:15.704267 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-70216228-cead-4b74-9ef0-cdef8109f8e6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1555 microversion: 2.1 time: 0.173069 Aug 11 10:09:15.704961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 560/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:09:15 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:09:16.728194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:16.728918 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:16.736515 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:16.737091 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:16.737598 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:16.738408 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:16.738935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:16.739430 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:16.846293 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:09:16.872945 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ae4121eb-b37f-4e5a-8ba9-f8e016e4b75a tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1513 microversion: 2.1 time: 0.141507 Aug 11 10:09:16.872945 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 575/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:09:16 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:09:16.930077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cf162e-835d-4ffd-a9a5-bddc1f373e23", "name": "network-vif-deleted", "tag": "3a88b0bc-20d6-49a2-81d4-43b248fbc764"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:09:16.930077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:16.930077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:16.930077 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:16.938293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] Creating event network-vif-deleted:3a88b0bc-20d6-49a2-81d4-43b248fbc764 for instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 on hv-cinder-81566 Aug 11 10:09:16.944198 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-acb9e0b2-7752-4258-bdc9-2eacaa37edd6 req-5dcf4f2e-b30c-477e-bfaa-1f08a9cb950a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Aug 11 10:09:16.944906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 561/1136] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:09:17.892571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:17.893305 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:17.899771 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:17.900248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:17.900681 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:17.901412 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:17.901860 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:17.902278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:17.940322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:17.940824 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:17.941286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:17.944064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lazy-loading 'fault' on Instance uuid f1cf162e-835d-4ffd-a9a5-bddc1f373e23 {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:09:17.994656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3839edcb09423b8b4885dffbd87af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93eee20443c14b739e06abe3eba34c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:09:18.001582 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b9c7d759-8712-4a5f-8029-02a876285fa6 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 200 len: 1349 microversion: 2.1 time: 0.113679 Aug 11 10:09:18.002420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 576/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:09:17 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 1349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:09:19.024345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:19.025053 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] [instance: f1cf162e-835d-4ffd-a9a5-bddc1f373e23] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:09:19.031415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:19.031906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:19.032345 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:19.033696 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:09:19.034149 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:09:19.034579 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:09:19.050156 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] HTTP exception thrown: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Request method failure captured: Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 HTTP/1.1 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NShDHmNXj6oxAloYATig9Pcp9U0TdgU9qV3NxFLz4r4jBfRF1Ou9G6BbxUnRaysBFnC39RPtf0qUIzvMfxo7HWniQYB07-d5p598Xn2ZADKzM2Y5bui1UvGkxmGnwHm38DJId7gn7X820V9FO97LPpZAGQ5k4TWEHa-6J5hR_pV35M Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: 93eee20443c14b739e06abe3eba34c44 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:09:19.051832 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/93eee20443c14b739e06abe3eba34c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_93eee20443c14b739e06abe3eba34c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: 93eee20443c14b739e06abe3eba34c44 Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1358197335 Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-TestMinimumBasicScenario-1358197335-project Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: 1f3839edcb09423b8b4885dffbd87af9 Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-TestMinimumBasicScenario-1358197335-project Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. Aug 11 10:09:19.053551 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': 'f1cf162e-835d-4ffd-a9a5-bddc1f373e23'} Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:09:19.054379 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. Aug 11 10:09:19.055610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:09:19.056750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Returning 404 to user: Instance f1cf162e-835d-4ffd-a9a5-bddc1f373e23 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:09:19.056750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-55d26d69-6e83-4c36-962f-db8ccdbb56b5 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23" status: 404 len: 111 microversion: 2.1 time: 0.033776 Aug 11 10:09:19.056750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 562/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:09:19 2022] GET /compute/v2.1/servers/f1cf162e-835d-4ffd-a9a5-bddc1f373e23 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:09:19.062186 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-2d833563-7b65-4e7f-a32e-708a45168083 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] Calling method '.version_select at 0x7f787c3050d0>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:09:19.187624 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-2d833563-7b65-4e7f-a32e-708a45168083 tempest-TestMinimumBasicScenario-1358197335 tempest-TestMinimumBasicScenario-1358197335-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2137065692" status: 202 len: 0 microversion: 2.1 time: 0.129205 Aug 11 10:09:19.188992 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 577/1139] 10.222.0.17 () {58 vars in 1272 bytes} [Thu Aug 11 10:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2137065692 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:09:43.983510 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:43.988135 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:44.179221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-cb03d250-d6c6-462b-ad78-d5dfa00ba856 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Action: 'create', calling method: .version_select at 0x7f787ccd8940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1867093865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh3gI/DDm8cA4Q0HP8WR0hdIvurES/pXcyZH+s2RgwjJ0haJ+VC05tfjmmwbppgne0ZIn/QD09GH4LctW5WxDgvbCdmCrVi1+/kWxjhCCQg0Xg0lTy2JdqrYC9eq4ctrw=="}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:09:44.196212 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-cb03d250-d6c6-462b-ad78-d5dfa00ba856 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Getting quotas for project 3ec3b6aa4cdb4187980e0fab84814b3c. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:09:44.200103 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.quota [None req-cb03d250-d6c6-462b-ad78-d5dfa00ba856 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Getting quotas for user f1a68eda0f5e4eec89510fdec0675f4f and project 3ec3b6aa4cdb4187980e0fab84814b3c. Resources: {'key_pairs'} {{(pid=121196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:09:44.277211 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-cb03d250-d6c6-462b-ad78-d5dfa00ba856 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298279 Aug 11 10:09:44.284609 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 563/1140] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Aug 11 10:09:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:09:51.149823 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:09:51.150388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Thu Aug 11 10:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:10:02.196150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:02.197064 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:02.203662 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2101372994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1867093865", "security_groups": [{"name": "tempest-secgroup-smoke-1176575316"}], "networks": [{"uuid": "6714c51a-9c43-4e43-a7b9-403a642d1e37"}], "block_device_mapping_v2": [{"uuid": "0027a927-7486-461f-a893-91db103452fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:02.413288 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.network.neutron [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] validate_networks() for [('6714c51a-9c43-4e43-a7b9-403a642d1e37', None, None, None, None, None)] {{(pid=121197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 10:10:02.802453 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Flavor limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 10:10:02.803646 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Image limits 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 10:10:02.804278 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Flavor pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 10:10:02.804691 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Image pref 0:0:0 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 10:10:02.805131 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.virt.hardware [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 10:10:02.813807 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:02.814286 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:02.814716 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:02.815439 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:02.815888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:02.816309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:02.835226 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Getting quotas for project 3ec3b6aa4cdb4187980e0fab84814b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 10:10:02.839137 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.quota [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Getting quotas for user f1a68eda0f5e4eec89510fdec0675f4f and project 3ec3b6aa4cdb4187980e0fab84814b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=121197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 10:10:02.895672 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Going to run 1 instances... {{(pid=121197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 10:10:02.898377 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0027a927-7486-461f-a893-91db103452fd',volume_size=None,volume_type=None)] {{(pid=121197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 10:10:03.346069 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a3c840b7-923b-46a3-b50c-9057a7342a43 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.151524 Aug 11 10:10:03.347023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 578/1141] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Aug 11 10:10:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 10:10:03.355409 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=4 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:03.356349 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:03.360251 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-db68ea85-a8f9-48c5-9ad8-3abc7d406f4d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:03.360860 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-db68ea85-a8f9-48c5-9ad8-3abc7d406f4d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:03.524112 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-db68ea85-a8f9-48c5-9ad8-3abc7d406f4d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:03.524789 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-db68ea85-a8f9-48c5-9ad8-3abc7d406f4d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1089 microversion: 2.1 time: 0.170758 Aug 11 10:10:03.525418 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 564/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:03 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1089 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:04.546314 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:04.547013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:04.554132 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:04.554602 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:04.555023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:04.555700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:04.556162 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:04.556557 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:04.618067 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:04.625481 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9a708c83-bce7-48ab-ad7c-5551673e2356 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1139 microversion: 2.1 time: 0.083454 Aug 11 10:10:04.626038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 579/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:04 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:05.648339 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:05.648966 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:05.659384 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:05.660965 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:05.661610 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:05.662969 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:05.664445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:05.667019 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:05.747036 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:05.754944 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-572cb484-1dda-4494-863e-81c855675655 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1205 microversion: 2.1 time: 0.112123 Aug 11 10:10:05.755570 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 565/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:05 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1205 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:06.776104 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:06.776707 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:06.783655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:06.784375 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:06.785039 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:06.785911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:06.786578 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:06.787194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:07.040388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:07.047954 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-93f9b4be-18f1-4075-90b3-f5408cb4066a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1273 microversion: 2.1 time: 0.275761 Aug 11 10:10:07.048518 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 580/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:06 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:07.533672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:07.545168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:07.545646 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:07.546118 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:07.557175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] Creating event network-changed:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:10:07.562291 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-62cba957-8aa9-46bd-b600-5e8e551ac5a8 req-67b4523f-6dd7-495b-abe4-b66f2ac01bbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033303 Aug 11 10:10:07.567130 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 566/1146] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:10:08.067794 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:08.068957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:08.075625 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:08.076106 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:08.076537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:08.077310 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:08.077894 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:08.078318 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:08.285885 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:08.293849 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0c8cc254-9368-45d7-bc8f-d070af9f927c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.230022 Aug 11 10:10:08.294872 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 581/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:08 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:09.315863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:09.316558 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:09.323202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:09.323685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:09.324119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:09.324804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:09.325294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:09.325717 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:09.465354 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:09.466737 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6239d6fc-d864-4d8d-9191-1b6ff85abc23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.155082 Aug 11 10:10:09.467293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 567/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:09 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:10.487661 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:10.488274 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:10.495386 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:10.495868 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:10.496297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:10.496975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:10.502437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:10.502437 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:10.626714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:10.635421 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-48856e93-b070-4fb0-af68-5ed6d53ddf7a tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.151645 Aug 11 10:10:10.635984 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 582/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:10 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:11.655804 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:11.656455 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:11.663424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:11.664161 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:11.664687 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:11.665424 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:11.665881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:11.666305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:11.798121 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:11.806318 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8ee52a62-668e-4dce-809c-a0dbd5f1f862 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.154448 Aug 11 10:10:11.806872 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 568/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:11 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:12.826229 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:12.826822 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:12.829130 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=2 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:12.834015 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:12.834495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:12.834928 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:12.835608 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:12.836056 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:12.836477 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:12.851233 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell0:SELECT=6 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:12.968280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:12.976059 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-5c758959-aee3-4f1a-ad34-f78abd38a825 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.153737 Aug 11 10:10:12.976629 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 583/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:12 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:13.997930 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:13.998575 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:14.001050 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell0:SELECT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:14.006672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:14.011681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:14.011681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:14.011681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:14.011681 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:14.012090 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:14.140248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:14.148282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-db077940-968b-4eaf-b0ea-016d07318e29 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.155536 Aug 11 10:10:14.148840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 569/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:13 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:15.168066 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:15.168665 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:15.175122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:15.175599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:15.176023 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:15.176692 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:15.177704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:15.178269 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:15.312050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:15.319782 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-b9aa9a52-0f67-4f3d-b9ff-8225abd50a78 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.155510 Aug 11 10:10:15.320335 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 584/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:15 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:16.339881 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:16.340482 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:16.347116 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:16.347596 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:16.348025 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:16.348706 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:16.349688 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:16.350105 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:16.479787 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:16.487292 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-20a9d59a-1e20-471c-a633-b9bd2600f0ca tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.151363 Aug 11 10:10:16.487866 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 570/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:16 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:17.102153 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "name": "network-vif-plugged", "status": "completed", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:17.112008 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:17.112479 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:17.112901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:17.123981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] Creating event network-vif-plugged:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:10:17.128999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-54dcc04b-c749-4f8d-a1aa-c29e10532784 req-dfc6da0c-16a4-46f8-855b-b8913bbaf65d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031079 Aug 11 10:10:17.129621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 585/1155] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:10:17.508893 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:17.509578 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:17.515913 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:17.516400 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:17.516833 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:17.517553 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:17.518007 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:17.518431 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:17.669891 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:17.677863 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-771c7af4-13d5-41fa-80eb-cca2b72e3a93 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.173258 Aug 11 10:10:17.678642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 571/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:17 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:18.699950 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:18.700715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:18.706831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:18.707309 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:18.707736 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:18.709055 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:18.709496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:18.709911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:18.838826 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:18.846556 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d8583b39-0bfc-4fd4-bd27-729c7631eef1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1261 microversion: 2.1 time: 0.151381 Aug 11 10:10:18.847112 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 586/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:18 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:19.867445 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:19.868085 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:19.874813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:19.875293 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:19.875726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:19.876411 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:19.876868 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:19.877329 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:20.011896 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:20.019474 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-56fa4994-419c-4aac-a051-1946c0541e3c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1445 microversion: 2.1 time: 0.156076 Aug 11 10:10:20.020035 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 572/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:19 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 10:10:20.039655 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:20.040249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:20.046567 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:20.047038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:20.047462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:20.048129 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:20.048600 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:20.049027 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:20.177138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:20.184656 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-385797d3-2357-4014-9cc6-41e636320b6c tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1445 microversion: 2.1 time: 0.148791 Aug 11 10:10:20.185258 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 587/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:20 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:21.498221 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:21.498762 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:21.505759 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:21.506248 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:21.506676 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:21.507587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:21.508041 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:21.508462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:21.535616 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:10:21.562545 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bff6d0c-0ec3-4615-8950-679ce724bc9e", "tag": "8ef6c489-1e33-458d-adce-db06cb58c6e4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:21.572962 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:21.573469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:21.573879 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:21.586316 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] Creating event network-changed:8ef6c489-1e33-458d-adce-db06cb58c6e4 for instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e on hv-cinder-81566 Aug 11 10:10:21.591622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-dc8a8f05-7230-403d-b8db-9b9c4952ba19 req-3ad5c7c2-dceb-4017-918c-fe70769f4d9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094898 Aug 11 10:10:21.592151 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 588/1160] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:10:21.920790 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-da15611b-e7f4-49ee-9bdd-1a4ee1d3675c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 204 len: 0 microversion: 2.1 time: 0.427428 Aug 11 10:10:21.921736 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 573/1161] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:10:21 2022] DELETE /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:10:21.931013 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:21.932373 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:21.938378 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:21.939113 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:21.939554 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:21.940246 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:21.940864 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:21.941320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:22.086831 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:22.113353 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3d02d248-3713-4374-b6a5-f96432242c82 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1575 microversion: 2.1 time: 0.187008 Aug 11 10:10:22.114029 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 589/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:21 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:22.198013 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:22.207946 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:22.208453 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:22.208875 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:22.223237 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] Creating event network-changed:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:10:22.229306 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-092a4949-b2bd-4549-a14b-9d5d8f712714 req-f6d294f9-e0a8-4d89-9016-c96a5e8e37ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035134 Aug 11 10:10:22.229918 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 574/1163] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:10:23.137188 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:23.138726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:23.146753 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:23.147468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:23.147974 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:23.149050 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:23.149511 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:23.149957 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:23.388865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:23.397520 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c5330efb-bcd5-4df2-bdac-46d819f39b4d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1575 microversion: 2.1 time: 0.265996 Aug 11 10:10:23.398601 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 590/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:23 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:24.419064 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:24.420398 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:24.431174 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:24.432136 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:24.432650 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:24.433389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:24.434083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:24.434511 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:24.627260 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:24.637129 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-631faa68-c1c3-4adc-baab-da0667336fbe tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1456 microversion: 2.1 time: 0.222260 Aug 11 10:10:24.637705 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 575/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:24 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1456 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:24.665999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6d0c-0ec3-4615-8950-679ce724bc9e", "name": "network-vif-deleted", "tag": "8ef6c489-1e33-458d-adce-db06cb58c6e4"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:24.676342 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:24.677438 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:24.677866 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:24.688769 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] Creating event network-vif-deleted:8ef6c489-1e33-458d-adce-db06cb58c6e4 for instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e on hv-cinder-81566 Aug 11 10:10:24.698469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-217e68ab-8f5a-4c86-b64a-2d49cbaaa8bc req-67375685-b990-4d5f-8774-bf030b77e844 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Aug 11 10:10:24.698469 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 591/1166] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:10:25.658233 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:25.658844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:25.666197 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:25.666753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:25.667249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:25.668022 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:25.668521 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:25.668945 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:25.701249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:25.701727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:25.702158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:25.702603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lazy-loading 'fault' on Instance uuid 1bff6d0c-0ec3-4615-8950-679ce724bc9e {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:10:25.746672 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:25.754119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e1a65041-ca75-4e97-b818-7433d0ecd0b5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 200 len: 1229 microversion: 2.1 time: 0.099883 Aug 11 10:10:25.754670 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 576/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:25 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:26.777294 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:26.777986 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 1bff6d0c-0ec3-4615-8950-679ce724bc9e] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:26.784092 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:26.784571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:26.785003 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:26.785704 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:26.786152 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:26.786575 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:26.801558 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] HTTP exception thrown: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Request method failure captured: Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e HTTP/1.1 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NO5ibQ6Gbd4G8yGs2YA5YJX5vt-VUoxoj2z6UkgmqjCk090s3qKQfcIFOruZ1KlSY-FxESfkP95HHu9h9mEh_6gBtszfct0vWdEVK4egksQytPmbw6Tbi6_F8MVBmESZPVIBOr64U11tcISL1ZiVCTLcuz9veprY3F118K2qPx4nB4 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:10:26.803146 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: ee81d8d9cf994df68a15afe5cb9673c4 Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. Aug 11 10:10:26.804901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '1bff6d0c-0ec3-4615-8950-679ce724bc9e'} Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:10:26.806025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. Aug 11 10:10:26.807660 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:26.809338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Returning 404 to user: Instance 1bff6d0c-0ec3-4615-8950-679ce724bc9e could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:10:26.809338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-ec63537f-b578-4823-966d-67eedf77f61d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e" status: 404 len: 111 microversion: 2.1 time: 0.031954 Aug 11 10:10:26.809338 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 592/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:26 2022] GET /compute/v2.1/servers/1bff6d0c-0ec3-4615-8950-679ce724bc9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:10:30.071437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:30.071964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:30.073473 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f34ff7a-4a51-4395-9343-71a40b0556da", "tag": "be44aa42-322c-4fb9-9860-b0f9c29a9800"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:30.078140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:30.078911 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:30.079350 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:30.080628 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:30.081330 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:30.081936 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:30.083758 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:30.084332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:30.084760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:30.096614 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] Creating event network-changed:be44aa42-322c-4fb9-9860-b0f9c29a9800 for instance 7f34ff7a-4a51-4395-9343-71a40b0556da on hv-cinder-81566 Aug 11 10:10:30.102503 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-129fadaa-f0c8-468b-9fe2-e7b89a433a68 req-ed38f01e-a2fb-4564-973d-68bd85715d03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Aug 11 10:10:30.103320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 593/1169] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:10:30.110179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Going to try to terminate instance {{(pid=121196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:10:30.406278 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-0b37b7e6-a63c-4274-a60c-09fd894c039c tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 204 len: 0 microversion: 2.1 time: 0.339406 Aug 11 10:10:30.407310 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 577/1170] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:10:30 2022] DELETE /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:10:30.417221 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:30.418283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:30.425291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:30.431739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:30.431739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:30.431739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:30.431739 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:30.432147 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:30.562924 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:30.570845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-07d4e1e2-5460-450d-acb3-09de0244cfa1 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1576 microversion: 2.1 time: 0.158287 Aug 11 10:10:30.571414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 594/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:30 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:31.592797 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:31.593518 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:31.600722 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:31.601236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:31.601674 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:31.602378 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:31.602813 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:31.603236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:31.783436 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:31.791587 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d8b4a211-ffc5-4117-9caf-b79ada4bedf5 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1576 microversion: 2.1 time: 0.203010 Aug 11 10:10:31.792169 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 578/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:31 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:32.768852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f34ff7a-4a51-4395-9343-71a40b0556da", "name": "network-vif-deleted", "tag": "be44aa42-322c-4fb9-9860-b0f9c29a9800"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:10:32.775054 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:32.780202 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:32.780673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:32.781134 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:32.784727 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=79 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:32.791975 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] Creating event network-vif-deleted:be44aa42-322c-4fb9-9860-b0f9c29a9800 for instance 7f34ff7a-4a51-4395-9343-71a40b0556da on hv-cinder-81566 Aug 11 10:10:32.796789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-b76c9831-899f-4901-acbf-149618881a0d req-a03e682e-c8ad-421f-be81-cf62a86f6b50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031565 Aug 11 10:10:32.797392 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 595/1173] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:10:32.813652 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:32.814343 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:32.821416 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:32.821904 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:32.822347 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:32.823119 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:32.823581 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:32.824086 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:32.828186 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:32.889240 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:32.898362 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-1d6a2131-3353-463d-90cb-4112c1977588 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1390 microversion: 2.1 time: 0.088522 Aug 11 10:10:32.898941 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 579/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:32 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:33.920788 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:33.921536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:33.928973 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:33.929474 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:33.929902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:33.930604 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:33.931038 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:33.931458 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:33.962028 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:33.962502 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:33.962927 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:33.963486 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.objects.instance [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lazy-loading 'fault' on Instance uuid 7f34ff7a-4a51-4395-9343-71a40b0556da {{(pid=121197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:10:34.005322 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee81d8d9cf994df68a15afe5cb9673c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea7b166d3468425ab368e369b4dd9989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:10:34.013291 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-359f8146-be9a-4532-a698-b2654e97649d tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 200 len: 1230 microversion: 2.1 time: 0.097225 Aug 11 10:10:34.013852 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 596/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:33 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:10:35.037593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:35.038228 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 7f34ff7a-4a51-4395-9343-71a40b0556da] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:35.041109 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:10:35.045678 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.046201 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.046637 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.047305 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.047776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.048199 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.061929 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] HTTP exception thrown: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Request method failure captured: Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da HTTP/1.1 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NO5ibQ6Gbd4G8yGs2YA5YJX5vt-VUoxoj2z6UkgmqjCk090s3qKQfcIFOruZ1KlSY-FxESfkP95HHu9h9mEh_6gBtszfct0vWdEVK4egksQytPmbw6Tbi6_F8MVBmESZPVIBOr64U11tcISL1ZiVCTLcuz9veprY3F118K2qPx4nB4 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:10:35.063534 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: ee81d8d9cf994df68a15afe5cb9673c4 Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. Aug 11 10:10:35.065296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '7f34ff7a-4a51-4395-9343-71a40b0556da'} Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:10:35.066340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. Aug 11 10:10:35.068001 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.069685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Returning 404 to user: Instance 7f34ff7a-4a51-4395-9343-71a40b0556da could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:10:35.069685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-2668f3db-3391-4633-a02c-33d3ff600eb0 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da" status: 404 len: 111 microversion: 2.1 time: 0.032112 Aug 11 10:10:35.069685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 580/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:35 2022] GET /compute/v2.1/servers/7f34ff7a-4a51-4395-9343-71a40b0556da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:10:35.814636 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:35.815150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:35.822192 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.822670 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.823096 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.823776 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.824224 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.824676 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.838547 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] HTTP exception thrown: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Request method failure captured: Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: DELETE /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 HTTP/1.1 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NO5ibQ6Gbd4G8yGs2YA5YJX5vt-VUoxoj2z6UkgmqjCk090s3qKQfcIFOruZ1KlSY-FxESfkP95HHu9h9mEh_6gBtszfct0vWdEVK4egksQytPmbw6Tbi6_F8MVBmESZPVIBOr64U11tcISL1ZiVCTLcuz9veprY3F118K2qPx4nB4 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:10:35.840194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: ee81d8d9cf994df68a15afe5cb9673c4 Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.841871 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '0bc4d305-287b-4a37-9d4d-99ceb3e3f720'} Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:10:35.842967 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.844537 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.846514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Returning 404 to user: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:10:35.846514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-7823b91d-d55d-4382-974b-c4284aced7fc tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 404 len: 111 microversion: 2.1 time: 0.030939 Aug 11 10:10:35.846514 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 597/1177] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:10:35 2022] DELETE /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:10:35.851187 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:35.851794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] [instance: 0bc4d305-287b-4a37-9d4d-99ceb3e3f720] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:10:35.858371 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.858847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.859279 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.859983 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:10:35.860462 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:10:35.860885 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:10:35.876494 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.wsgi [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] HTTP exception thrown: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Request method failure captured: Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: request: GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 HTTP/1.1 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept: application/json Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Accept-Encoding: identity Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Connection: close Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Length: 0 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Content-Type: application/json Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Host: 10.222.0.17 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Openstack-System-Scope: None Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: User-Agent: python-urllib3/1.26.11 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Auth-Token: gAAAAABi9NO5ibQ6Gbd4G8yGs2YA5YJX5vt-VUoxoj2z6UkgmqjCk090s3qKQfcIFOruZ1KlSY-FxESfkP95HHu9h9mEh_6gBtszfct0vWdEVK4egksQytPmbw6Tbi6_F8MVBmESZPVIBOr64U11tcISL1ZiVCTLcuz9veprY3F118K2qPx4nB4 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Id: None Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Domain-Name: None Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Identity-Status: Confirmed Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Is-Admin-Project: True Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Id: default Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Domain-Name: Default Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Project-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Role: reader,member Aug 11 10:10:35.878026 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Roles: reader,member Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ea7b166d3468425ab368e369b4dd9989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Id: ea7b166d3468425ab368e369b4dd9989 Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1032242296 Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Id: default Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Domain-Name: Default Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Id: ee81d8d9cf994df68a15afe5cb9673c4 Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: X-User-Name: tempest-TestVolumeBootPattern-1032242296-project Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: method: > Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: exception: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.879680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: action_args: {'id': '0bc4d305-287b-4a37-9d4d-99ceb3e3f720'} Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:10:35.881375 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. Aug 11 10:10:35.882961 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: ERROR nova.api.openstack.wsgi Aug 11 10:10:35.884448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Returning 404 to user: Instance 0bc4d305-287b-4a37-9d4d-99ceb3e3f720 could not be found. {{(pid=121196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:10:35.884448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-e0f83c89-313f-449b-bdaa-2f38a5087527 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720" status: 404 len: 111 microversion: 2.1 time: 0.032908 Aug 11 10:10:35.884448 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 581/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:10:35 2022] GET /compute/v2.1/servers/0bc4d305-287b-4a37-9d4d-99ceb3e3f720 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:10:37.391179 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0ea5e8d3-9291-41fb-9ff2-4a907bdea977 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] Calling method '.version_select at 0x7f787c627d30>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:10:37.475048 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0ea5e8d3-9291-41fb-9ff2-4a907bdea977 tempest-TestVolumeBootPattern-1032242296 tempest-TestVolumeBootPattern-1032242296-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1138903170" status: 202 len: 0 microversion: 2.1 time: 0.087703 Aug 11 10:10:37.475632 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 598/1179] 10.222.0.17 () {58 vars in 1263 bytes} [Thu Aug 11 10:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1138903170 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:11:28.761988 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:11:28.762607 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Thu Aug 11 10:11:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:12:17.484715 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:12:17.485441 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:17.487365 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=8 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:17.492188 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:17.492753 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:17.493234 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:17.493917 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:17.494364 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:17.494781 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:17.517068 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lazy-loading 'flavor' on Instance uuid 15ce1ff4-af89-4aa0-9432-06314ddef820 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:12:17.716794 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-13fc59e4-caac-44d4-a6b6-3ed0068db734 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "POST /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820/action" status: 202 len: 0 microversion: 2.1 time: 0.236802 Aug 11 10:12:17.717407 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 582/1180] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:12:17 2022] POST /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:12:17.724906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=11 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:17.725680 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:17.731731 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:17.732118 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:17.738022 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:17.738441 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:17.738876 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:17.739563 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:17.740018 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:17.740439 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:17.872315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:17.879865 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-47064fc9-7c17-481a-862d-69d0affdb8de tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.157314 Aug 11 10:12:17.880417 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 599/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:17 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:18.903399 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:18.904091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:18.910202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:18.910680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:18.911115 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:18.911799 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:18.912254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:18.912679 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:19.051084 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:19.059174 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-22ec4a71-dee1-46f2-ad8a-c83c69c75195 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.161252 Aug 11 10:12:19.059727 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 583/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:18 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:20.080195 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:20.080789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:20.087332 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:20.087816 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:20.088248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:20.088935 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:20.089415 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:20.089845 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:20.224227 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:20.232270 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0dd07fed-2557-4bf3-97e3-64343e537229 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.155987 Aug 11 10:12:20.232833 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 600/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:20 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:21.252858 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:21.253486 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:21.260018 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:21.260502 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:21.260934 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:21.261643 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:21.262098 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:21.262522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:21.390273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:21.397724 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-3c0a7b24-85c4-4c47-8f6b-a0d09e535692 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.148820 Aug 11 10:12:21.398985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 584/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:21 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:22.419696 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:22.420311 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:22.426791 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:22.427271 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:22.427702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:22.428382 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:22.428830 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:22.429283 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:22.563126 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:22.570619 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-746c5b0b-0655-4c8a-be25-18006fa370f8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.154833 Aug 11 10:12:22.571279 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 601/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:22 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:23.592254 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:23.592867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:23.599491 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:23.599968 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:23.600405 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:23.601113 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:23.602370 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:23.602795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:23.732895 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:23.740395 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-5e4912c8-e4f6-4503-9b4f-40d27f491c7d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.152071 Aug 11 10:12:23.740957 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 585/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:23 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:24.762116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:24.762679 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:24.768983 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:24.769489 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:24.769920 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:24.770599 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:24.771074 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:24.771497 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:24.900968 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:24.908526 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c47c8c91-6334-4aa3-8a3c-c866272f1f95 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.151096 Aug 11 10:12:24.909108 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 602/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:24 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:25.929701 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:25.930338 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:25.936747 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:25.937261 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:25.937697 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:25.938391 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:25.938847 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:25.939273 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:26.078850 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:26.087408 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-af62c8e8-0a77-4538-b145-33e1c5be8394 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.161568 Aug 11 10:12:26.087971 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 586/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:25 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:27.108686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:27.109333 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:27.115857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:27.116334 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:27.116759 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:27.117462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:27.117906 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:27.118320 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:27.248232 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:27.255706 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9ab33d4b-0bd5-49ef-9be9-78cd4a288d13 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.150992 Aug 11 10:12:27.256266 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 603/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:27 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:28.277825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:28.278440 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:28.289415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:28.289415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:28.289415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:28.289415 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:28.289795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:28.289795 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:28.745774 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:28.753202 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-37e2344f-32fb-4cac-849e-597dff2cfabc tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.480017 Aug 11 10:12:28.753770 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 587/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:28 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:29.774360 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:29.775025 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:29.781765 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:29.782250 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:29.782709 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:29.783396 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:29.783850 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:29.784273 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:29.912218 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:29.920336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-4306fc57-9789-4271-b032-9984e1d484e1 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.149883 Aug 11 10:12:29.920901 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 604/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:29 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:30.940635 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:30.941270 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:30.949175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:30.949175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:30.949175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:30.949175 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:30.949623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:30.949623 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:31.083389 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:31.091609 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-22d9e3ce-7a8c-44b0-b875-9f0db3ebadb6 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.154727 Aug 11 10:12:31.092176 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 588/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:30 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:32.113715 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:32.114347 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:32.121874 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.123367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.123367 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.123590 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.123925 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.124344 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.255722 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:32.263914 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-d684a4de-8b0f-4928-bb8f-e5ab013be8cd tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1510 microversion: 2.1 time: 0.154052 Aug 11 10:12:32.264414 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 605/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:32 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:32.284083 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:12:32.284682 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:32.291951 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.292432 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.292874 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.293595 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.294053 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.294478 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.468975 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121196) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 10:12:32.771533 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-d5a3f264-5863-4aaf-a8da-b5cd21577129 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "POST /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820/action" status: 202 len: 0 microversion: 2.1 time: 0.491409 Aug 11 10:12:32.772142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 589/1194] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Aug 11 10:12:32 2022] POST /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:12:32.780895 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:32.784902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:32.787468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.787964 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.788380 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.789093 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:32.789543 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:32.790606 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:32.926496 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:32.934942 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c757623a-96e0-4384-a617-2ad96c497d52 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1518 microversion: 2.1 time: 0.157871 Aug 11 10:12:32.935505 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 606/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:32 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:33.956437 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:33.956985 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:33.963730 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:33.964209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:33.964639 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:33.965358 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:33.965869 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:33.966298 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:34.106420 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:34.114933 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f7bdcad5-b840-4f56-848a-e2a0de777b23 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1520 microversion: 2.1 time: 0.163109 Aug 11 10:12:34.115503 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 590/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:33 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:35.139402 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:35.140133 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:35.146653 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:35.147191 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:35.147621 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:35.148297 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:35.148766 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:35.149209 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:35.280267 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:35.289150 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-07eb0f50-3194-4167-b49e-afb0cfe6950b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1520 microversion: 2.1 time: 0.153045 Aug 11 10:12:35.289777 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 607/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:35 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:35.569767 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "name": "network-vif-unplugged", "status": "completed", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:12:35.579368 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:35.579836 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:35.580258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:35.592699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] Creating event network-vif-unplugged:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:12:35.597964 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-cb3f194b-76f0-4bc7-aac8-491220a721fe req-aaec123d-25c5-43f8-8921-394b8e12795e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089233 Aug 11 10:12:35.598766 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 591/1198] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:12:36.310956 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:36.311544 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:36.318294 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:36.318851 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:36.319336 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:36.320017 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:36.320462 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:36.320882 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:36.454222 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:36.461748 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-c15cc349-85b5-484d-a2af-105838c27f83 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.155426 Aug 11 10:12:36.462312 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 608/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:36 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:37.484522 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:37.485238 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:37.491281 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:37.491751 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:37.492178 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:37.492854 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:37.493330 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:37.493750 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:37.626131 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:37.633680 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-08254529-7030-4b74-81ad-78fbbb05a502 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.153834 Aug 11 10:12:37.634243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 592/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:37 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:38.657510 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:38.658111 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:38.664522 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:38.664999 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:38.665457 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:38.666768 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:38.667254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:38.667673 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:38.798591 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:38.806110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-68198e21-27f9-4875-b374-a525fe17ee16 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.152536 Aug 11 10:12:38.807356 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 609/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:38 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:39.828571 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:39.829140 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:39.835685 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:39.836168 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:39.836603 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:39.837316 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:39.838376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:39.839091 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:39.966573 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:39.974313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-8ffabce7-6aa4-4325-8a49-8f56f58f90e8 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.149855 Aug 11 10:12:39.974877 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 593/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:39 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:40.995536 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:40.996144 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:41.002789 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:41.003281 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:41.006262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:41.006262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:41.006262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:41.006262 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:41.138337 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:41.146428 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a692dbb0-fddb-4c0a-851a-2e5eee9a2113 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.155277 Aug 11 10:12:41.146979 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 610/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:40 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:42.167773 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:42.168376 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:42.174844 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:42.175317 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:42.175745 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:42.176421 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:42.176867 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:42.177320 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:42.308499 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:42.315927 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-05786a38-b895-419c-a951-effedbd64184 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.152193 Aug 11 10:12:42.316485 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 594/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:42 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:43.336700 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:43.337357 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:43.344254 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:43.344726 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:43.345183 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:43.345857 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:43.346300 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:43.346971 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:43.478760 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:43.486361 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-cf547925-49fc-46e7-98fe-c0e3ca8d7868 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.153570 Aug 11 10:12:43.487277 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 611/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:43 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:44.507476 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:44.508148 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:44.514636 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:44.515114 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:44.515543 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:44.516223 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:44.516675 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:44.517123 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:44.651299 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:44.658764 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-c6a3b996-bff0-4e93-8108-0951266bd341 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.155151 Aug 11 10:12:44.659327 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 595/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:44 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:45.679907 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:45.680699 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:45.687570 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:45.688045 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:45.688574 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:45.689181 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:45.689634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:45.690981 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:45.824117 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:45.831888 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-9c503fb3-5d10-4f84-b0d9-35074ba5be75 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.156080 Aug 11 10:12:45.832449 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 612/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:45 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:46.852638 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:46.853433 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:46.859743 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:46.860217 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:46.860642 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:46.861353 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:46.861806 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:46.862222 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:46.866243 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:46.996397 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:47.003846 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-a16cfacc-e3f6-489a-a73a-a76d33003dc4 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.155131 Aug 11 10:12:47.004403 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 596/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:46 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:47.583900 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "name": "network-vif-plugged", "status": "completed", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:12:47.595933 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:47.596407 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:47.597110 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:47.608571 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.compute.server_external_events [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] Creating event network-vif-plugged:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:12:47.613965 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [req-28f5b687-8eb8-4a28-886c-bd058bcd7299 req-bb7cf072-d59f-4da1-886b-e198970f7967 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033802 Aug 11 10:12:47.614539 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 613/1209] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:12:48.028108 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:48.028726 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:48.031070 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:48.035629 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:48.036124 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:48.036546 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:48.037263 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:48.037716 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:48.038138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:48.172670 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:48.180031 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-f04e0543-6404-4fe5-9ed5-264bba101e4f tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.156619 Aug 11 10:12:48.180593 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 597/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:48 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:49.201988 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:49.202695 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:49.205122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=31 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:49.210208 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:49.210686 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:49.211116 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:49.211799 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:49.212249 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:49.213194 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:49.215712 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=87 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:12:49.343917 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:49.352459 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-bf6fa3f4-9a33-450c-855e-e771b7ace589 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1576 microversion: 2.1 time: 0.153867 Aug 11 10:12:49.356388 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 614/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:49 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:12:50.374142 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:12:50.374805 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:12:50.381231 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:50.381712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:50.382147 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:50.382826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:12:50.383277 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:12:50.383699 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:12:50.514296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:12:50.521677 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-00534739-98c8-43b5-b70d-84786b87f1ac tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1563 microversion: 2.1 time: 0.151382 Aug 11 10:12:50.522235 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 598/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:12:50 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:13:03.660911 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:13:03.661498 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Thu Aug 11 10:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:13:11.158012 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:13:11.158634 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Thu Aug 11 10:13:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:14:03.815677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:03.816272 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:03.819796 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_api:SELECT=3 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:14:03.820800 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG dbcounter [-] [121196] Writing DB stats nova_cell1:SELECT=16 {{(pid=121196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:14:03.822495 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_api:SELECT=1 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:14:03.823896 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG dbcounter [-] [121197] Writing DB stats nova_cell1:SELECT=5 {{(pid=121197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:14:03.824776 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:14:03.829149 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:03.829637 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:03.830063 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:03.831248 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:03.831892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:03.832307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:03.835117 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:03.838723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:03.838723 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:03.848778 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] Creating event network-changed:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:14:03.854459 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-fb53d2c7-e4ac-437c-a622-095115c8b909 req-7d209f50-c675-4c60-81ae-a3f4520e87bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036132 Aug 11 10:14:03.855294 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 599/1213] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:14:03.862703 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Going to try to terminate instance {{(pid=121197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 10:14:04.318688 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-3aa0639b-2433-4810-bf66-b5f4023a244e tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 204 len: 0 microversion: 2.1 time: 0.507446 Aug 11 10:14:04.319802 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 615/1214] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Aug 11 10:14:03 2022] DELETE /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 10:14:04.336158 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:04.337179 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:04.345313 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:04.345840 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:04.346495 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:04.347622 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:04.348258 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:04.348906 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:04.491289 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:14:04.499903 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ed000d05-8f76-44af-8de2-7af041db38ce tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1569 microversion: 2.1 time: 0.167836 Aug 11 10:14:04.500576 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 600/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:14:04 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:14:05.523315 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:05.606628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:05.606628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:05.606628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:05.606628 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:05.607138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:05.607138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:05.607138 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:05.671750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:14:05.679455 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-f0474368-0c4a-4aab-88ec-9796ab177c5d tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1451 microversion: 2.1 time: 0.160724 Aug 11 10:14:05.680010 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 616/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:14:05 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:14:06.572249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce1ff4-af89-4aa0-9432-06314ddef820", "name": "network-vif-deleted", "tag": "bd7e5794-78a8-4d75-8265-05354fcbcf97"}]} {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:14:06.572249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:06.572249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:06.572249 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:06.573568 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.compute.server_external_events [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] Creating event network-vif-deleted:bd7e5794-78a8-4d75-8265-05354fcbcf97 for instance 15ce1ff4-af89-4aa0-9432-06314ddef820 on hv-cinder-81566 Aug 11 10:14:06.578332 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [req-bc73deca-df07-4a8a-be2a-a653041d31cb req-8c80c271-b88f-4b8b-91f6-10b0e8838056 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Aug 11 10:14:06.578926 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 601/1217] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Aug 11 10:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:14:06.700525 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:06.701161 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:06.707750 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:06.708230 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:06.708698 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:06.710139 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:06.710675 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:06.711751 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:07.033877 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.policy [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:14:07.042122 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-0a9b959f-2fb5-45de-aab4-87523ec12350 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1220 microversion: 2.1 time: 0.345461 Aug 11 10:14:07.042702 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 617/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:14:06 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1220 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:14:08.064900 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:08.066912 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.compute.api [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:08.073236 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:08.073712 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:08.074138 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:08.074826 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:08.075274 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:08.075692 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:08.108825 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:08.109333 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:08.109772 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG oslo_concurrency.lockutils [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:08.110209 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.objects.instance [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lazy-loading 'fault' on Instance uuid 15ce1ff4-af89-4aa0-9432-06314ddef820 {{(pid=121196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 10:14:08.151783 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.policy [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a68eda0f5e4eec89510fdec0675f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec3b6aa4cdb4187980e0fab84814b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 10:14:08.159296 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-ee492550-79e5-49e9-bb6e-afd8b4357f91 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 200 len: 1225 microversion: 2.1 time: 0.099053 Aug 11 10:14:08.165594 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 602/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:14:08 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:14:09.180677 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '>' {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:09.181307 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.compute.api [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] [instance: 15ce1ff4-af89-4aa0-9432-06314ddef820] Fetching instance by UUID {{(pid=121197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 10:14:09.187796 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:09.188280 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:09.188714 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:09.189442 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Acquiring lock "ae211188-ecfc-4a58-9f59-b381cd08d799" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:14:09.189892 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:14:09.190902 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG oslo_concurrency.lockutils [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Lock "ae211188-ecfc-4a58-9f59-b381cd08d799" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:14:09.204763 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.wsgi [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] HTTP exception thrown: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Request method failure captured: Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: request: GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 HTTP/1.1 Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept: application/json Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Accept-Encoding: identity Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Connection: close Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Length: 0 Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Content-Type: application/json Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Host: 10.222.0.17 Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Openstack-System-Scope: None Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: User-Agent: python-urllib3/1.26.11 Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Auth-Token: gAAAAABi9NVh--XRBTncj_TzKegBKRkuo9jYk2KvaZXgvh1H20pYgdeONzN2R7dr9eZDVUjTher2Me1xzs1phaahZGyMCE0yVGnIuI1i4S0tOY6946WbjJlYPEEOMSHPUJxSW7n4EKdnqHe-Bw2XEtWUTzITprJEO002Qq8gV32449-3fnjn4IA Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Id: None Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Domain-Name: None Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Identity-Status: Confirmed Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Is-Admin-Project: True Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Id: default Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Domain-Name: Default Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Id: 3ec3b6aa4cdb4187980e0fab84814b3c Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Project-Name: tempest-TestShelveInstance-750999319 Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Role: reader,member Aug 11 10:14:09.208853 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Roles: reader,member Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ec3b6aa4cdb4187980e0fab84814b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ec3b6aa4cdb4187980e0fab84814b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3ec3b6aa4cdb4187980e0fab84814b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3ec3b6aa4cdb4187980e0fab84814b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant: tempest-TestShelveInstance-750999319 Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Id: 3ec3b6aa4cdb4187980e0fab84814b3c Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-Tenant-Name: tempest-TestShelveInstance-750999319 Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User: tempest-TestShelveInstance-750999319-project Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Id: default Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Domain-Name: Default Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Id: f1a68eda0f5e4eec89510fdec0675f4f Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: X-User-Name: tempest-TestShelveInstance-750999319-project Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: method: > Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: exception: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. Aug 11 10:14:09.210730 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: action_args: {'id': '15ce1ff4-af89-4aa0-9432-06314ddef820'} Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: {{(pid=121197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:14:09.211755 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. Aug 11 10:14:09.213468 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: ERROR nova.api.openstack.wsgi Aug 11 10:14:09.215622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: DEBUG nova.api.openstack.wsgi [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Returning 404 to user: Instance 15ce1ff4-af89-4aa0-9432-06314ddef820 could not be found. {{(pid=121197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:14:09.215622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO nova.api.openstack.requestlog [None req-a442f290-7057-4c4c-aaaa-f13b281bbc6b tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820" status: 404 len: 111 microversion: 2.1 time: 0.031704 Aug 11 10:14:09.215622 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: [pid: 121197|app: 0|req: 618/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Aug 11 10:14:09 2022] GET /compute/v2.1/servers/15ce1ff4-af89-4aa0-9432-06314ddef820 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 10:14:09.458561 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: DEBUG nova.api.openstack.wsgi [None req-6d5b1b4f-c804-4aa0-857f-3dc102f22005 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] Calling method '.version_select at 0x7f787c249ca0>' {{(pid=121196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:14:09.546889 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO nova.api.openstack.requestlog [None req-6d5b1b4f-c804-4aa0-857f-3dc102f22005 tempest-TestShelveInstance-750999319 tempest-TestShelveInstance-750999319-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1867093865" status: 202 len: 0 microversion: 2.1 time: 0.092191 Aug 11 10:14:09.547473 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: [pid: 121196|app: 0|req: 603/1221] 10.222.0.17 () {58 vars in 1254 bytes} [Thu Aug 11 10:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1867093865 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 10:16:23.670801 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:16:23.671420 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Thu Aug 11 10:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:16:24.910282 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:16:24.910890 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Thu Aug 11 10:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:16:31.166275 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:16:31.166891 dv-cinder-815660-9-iscsi devstack@n-api.service[121197]: Thu Aug 11 10:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 10:18:08.773673 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 10:18:08.774340 dv-cinder-815660-9-iscsi devstack@n-api.service[121196]: Thu Aug 11 10:18:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!